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Yearly, we at Educational |£g Service are 
.. impressed by the increlsing^^phers of those 
., interested in testing who come to the Invitational 
< Conference on Testing PrM&n§, More than 
350 persons! the largest arondance in its 15 
year history, aisemiieS W^fow York for the 
1951 Gonference^ €WsMsi^OT^ent testimonial* 
I think, to the need for' and; stimulation of the 
occasion* The^ published record of the proceed- 
ings will, I hope, spread more widely the infor- 
mation and wisdom eptftajned in the papfers 
presenteH by *the distinguished speakers, 

This year we have included in tl^e* proceed- 
ings a TOhscript pf General Hershey's remarks 
t at the, Conference luncheon, an innovation at 
v , the 1951 Conference, / f 

As is always t}\e case^ the Chairman of the 
f Coherence has the burden, many months in 
advance, of insuring an interesting, challenging, 
and successful meeting* In the capable custody 
of H^rixy S. Dyer, I knew, long before November; 
\ the Invitational Conference on Testing ProUifihs 
wcfald meet these goals. I can only add to' the 
mafcy favorable c5mments and letters already 
receiyed my own deep and sincere appreciation. 

Henry Chauncey, President 
> ' Educational Testing Service 
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PREFACE 



The i$SL tiri&%$q4 Conference' 

V the ^dnsorsh^ ' of the Educational \ 
I , Tisting' Service, it ; 0ie Roosevelt 
Hotel, New York City, November 3- 
1951. wai attended by 350 in" 
1 ' dividuals from s4 states and 3 foreign 
• / ediffitnes* The program consisted of 
\ / ^fo1ir ( units: (l) a parcel discussing 
/-'}: f 4 *Th^ Supply and Identification of 
'• /'• High Level Talent" (2)" air address 
■ : by Dr. Paul L. B Dressel on "The 
Problems of Evaluation in General 
^Education" (3) a. luncheon address 
by Major&eneral Lewis B. Hershey ' 
on "Military Manpower Problems" 
■ "(4) a panel discussing '"The Develop- 
ment of Useful Tests of Non4ntellee* 
tual Functions*" 1 

These subjects were selected for 
discussion in the "belief that they 
represent points of contact between 
test development and some of the 
most critical problems facing Ameri- 
can society today. The pressure on 
skilled manpower occasioned by the 
program of National Defense, the 
widespread movement toward some 
form of general education in the 
colleges; and the need for better s un= 
derstanding of personal adjustmejft 
in a world of tension— all of these 



matters^ generate problems that test 
Jmikers arej*e^ tosolye. 

The papers and discussions that 
constitute the .main body of tliis vol- 
ume demonstrate thatf there are no 
ready-made solutions* One discovers, 
indeed* that there is not even Any 
universal agreement as to the Under- 
lying postulates oft which fruitful 
approaches to the problems might 
rest The 1951 Conference* like many 
that have preceded it, has brought 
these issues into the open And helped - 
to clarify them/ The whole discus- 
sion, in fact, seems to reflect an in- 
creasing .concern for finding that 
series of concepts from which emy 
pyical studies can most profitably 
take off, 

f r. The foregoing, however, should not 
'carry the implication that the partioij 
pants in the Conference are "mere* 
theoreticians," Quite the contrary. 
Every one of them is actively engaged 
in research or other activities in- 
volving the practical application of 
psychometric techniques m concrete 
situations, And^or every okeof them 
participation in the Conference in- 
volved a^sacrifice of valuable tinwout 
of a busy schedule* I am happ^'to , 
have this opportunity to thank them 
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The Supply and Identification of High Level Jalent 

• ' TO B Y 0 X T 0:B Y 

THREE BASIC PROBLEMS^, 

J - ' "*««•* ' » • 

TiiE supply and identification of . pbrttfht" to our nation Am QtherA 

high level talent is a major problem Such a>difference is ^iffipult to de-- 

to which the Commission on Human * fend, fieldfare needed as integral 

Resources and Advance Training has parts of our economy j-lpss of any - 

addressed itself for the past year, ft dhe fiefft as an active grdnp would • 

is not a problem which can be solved havi^repereuislons no| only for that 

in one yearl or in ten years for that field *iut for many others as well, 

inciter, and-the t^mnlissipn lias only Again it might be su|fposejl tbiftt some, 

begun to, make a preliminary assessv fields could be rated more top level 

ment iof it I think that it will be than others on Uie^ basis that a higher 

satisfied if it can make onjy a good intelligence level is Required, tut at 

start toward bringing the pfobtem though differences are found ^arto% 

into focus so that reasonable, solu— the average intelligence levels" of 

Hons . of its various aspects may even- different Jields ? * these differences are 

dually be found. ". flight in ^oinparlson with the raifge 

Different things are often meant of scores within a field and, with the 

by the expression "higrUevel talent." overfall difference between these fields 

The Commission on Human t Re- and the general population, 

sources thinks of it^as a person who * Let me again m*ke clear that the . 

is able to work and earn a living in definition of high level talent I am" 

the sciences, social sciences, humani- using refers to persons w|jo can sue- 

ties, or professions. It may seem ques- eesafully earn' their livelihood *as 

tlonable whether members of all of members of these various fields* 1 It 

these various fields' should ,be in- is not necessari^ concerlned with all 

chafed under the general deeeripv persons who eari earn degrees in these 

tlon of top levej talent It is immedi- specialized fields. . Every year; for 

ately obvious, however, that they all .example, seven or eight thousand per- 

have one thing in common: a certain sons receive bachelor's degrees in 

. minimum level of intelligence is re- psychology. Yet a maximum of only 

quired as well as a fairly long period 1,300 of; these eventually work as 

of formal education in an institution psychologists. This example makes > 

of higher learning. Occasionally, dif- clear that in tills area our' Interest 

ferentiation is made betv&een the fields is* not in identifying persons who 

on 'the basis that some are more "im- will do well in the study of psycho!- : 

[ i3 1 , _ r- ( • ; 



ogy, but rather in identifying per- occupations ii that "nearly ail gradu= 
sons who can and up by actually ■ ate?J from college, we will 1 find that 

working in the field. s the younger the group of persons in 

jtiififli pmhlpni therefore, is the population we consider, the larger* 

to obtain information dn -what per- will be the supply of lop level talent, 

sons now working in the top level It is dear that college graduates over 

areas are like, Studies on the inteili- the next four yean are limited to 

gence, academic achievement, motiva- persons who have already entered 

tion, personality, etc, of persons now college, and we know* that the gradu- 

aclually engaged in these fields have ating class of 4955 will represent a 

not been very common. For this substantial decrease from the number 

reason, the Commission on Human of persons who began college this fall. 

Resources and Advanced Training is . Likewise/ the number of persons who 

spending a considerable amount of Its graduate in 1956 M limited by the 

^ research time in collectin^tiata on number who will graduate from high 

** tlUa subject 'Studies to date indicate school this coming June. But at this 

that it is not always the most intelli- level we find a substantial increase 



gent, nor the individual with the 
greatest academic promise who ends 
up as a member of these fields. An 
overwhelming number of such per- 
sons are, however, quite high on at 
least one of these varia^Jes, 

An understanding of the supply* 
of top level^ talent "depends on an 
understanding of the characteristics 



of persons now working in the sci- >top level fields 



in the supjSfy of high level talent. Of 
the top quarter of high school gradu* 
ates in scholastic standing, for ex* 
ample, less than half enter college as 
full time students. While still in high 
school this group may be considered 
as good [potential material but those 
of the gibup who fail to enter college 
are lost forever as prospects for our 



enees, social sciences, humanities, and 
professions. Once we know the pat- 
tern of intelligence, academjc achieve* 
ment, personality, etc. of persons cur- 
rently in these areas,, we are in a posi- 
tion to determine how many ijidi- 
viduals there are iff*^he population 
who are similar to them^JMorfun- 
ately, the number deterinined, by this 
method is not really the supply of top 
level talent. It is, however, a soft of 
least upper bound to the supply. 

Since om\ characteristic of per- 
sons how wdrWing'in these specialized 



The whole story of why these po- 
tentially abW persons drop out so 
early is still riot = completely known, 
Perhaps the most common reason ad- 
vanced^ relates to the financial status 
of the student's famjfy. Many studies 
have shown that ^he greatest drop 
out of high level talent is among per- 
sons who came from the lower eco- 
nomic, groups a Finances themselves 
are not the whole story, however, 
since these economic^groups are more 
likely to consider education a waste 
of time, If the reason for non-attehd- 
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ance ii financial, the ri&mber of per- interests, and .attrition of awdenta at 
« son. continuing on in ^Khool , could , both the high school arid^oUege level. 

'undoubtedly be increased by a mors This information Will give us a rea- 
-^JilwwUiatdMJdiL^ptf^ aMimateoj. 'he 

, the reason relates more to family atti- number of persons Who eo$ld under 
tude/howefer, it would^a m6ch different lorfc of mdueemehts be e^ 
m^re .difficult job to increase the pectedrfS go intqjthetop >vel fields. 
f 'numbefattenlUng college. - * Any consideration ^methods 

' , A factor .not often emphasised here by . which young people, might be in- 
) * is that there are" other demands made 
on this group of high level talent. 
High intelligence has other uses than 
. in the fields requiring hi|her educa- 
tion. It has often been said that a 
smarUpersen can be pretty successful 
in almost anything he tries, Ger- 
tainly the ultimate' location of top 



level talent depends very largely .jp 
the interests and * motivations the 



dueed to go into these , fields must 
tAke*teto account the question of do- 
many for top level talent. Because 
the demand in most of the specialized 
lipids has always, been small in re- 
lationship to the total number*^ per- 
sons graduating from college the 
amp out of members/of the top talent 
group has in the ■pqjt been considered 
more of a loss to the individual con- 
'eerned than to the r/ation itself. In 
the past few years however; there 
' ftve been indications that like so 



young person develops- either in his 
' home, school, or Mrmmunity. Here 

.there is the two Jt€p problem of first 

* finding out whether such individuals .many other of our natural resources 

are better off going into the special- that have come close to «^'°n 

" wed fields, and secondly,*!! an affirm- by a tremendously growing dAnand, 

alive answer Is given, of -developing we are beginning to run short on our 

interests 4n that direction- , human resources. A quick glance at 

This brief sketch of some of the the field of •engineering should con- 

speculations in this area demonstrates vWe you, for example, that the job 

that any assessment of the top level opportunities and training facilities 

talent must depend on a fairly accu- ,grearty exceed the- number of persons 

rate understanding of the reasons why \vith the capability, the motivation, 

able students drop out various and the preparation . fojr engineering.- 

'stages in the educational process. We 1 The question of future demand, 

must also have some' knowledge of in any field is a difficult .one, and ,t 

the motivation, interests, and plans » particularly difficult in fieWs which 

of these 'groups of top level talent, require top level talenL The ,. Lorn- 

For this reason the Commission on mission has, however, set for itselt as 

' Human Resources is conducting or a major task the making of such pr*. 

. cooperating in a rather 'extensive dictions. These predictions must have 

series of studies of the motivations, as a base growth trends in the fields 
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Human Resources and Advanced 
Training is doing, I have tried to em- 
phasize the clost 1 interrelationship of 
the status quo, supply, and future 
demand* aspects of the problem^ Iri 
the first place, to identify top level ta- 



for .the past twenty or thirty years, 

Reliable growth curves are nqt gen- 
erally available, but by digging up 
^ scattered facts from many sources, 

predicting trends for .entire groups on 
i the basis of small samples, and 3 taking 

advantage of consistencies of certahs lent we must become acquainted with 
, trends and. relationships among * the the* characteristics of persons now 

various fields, trend curves are gradu- . working in the fields requiring higher 
' all > bein S ! assembled, From these, education/- In the second place we 

majpr trend lines predictions of what . !nugl khow how — person3 ln ^ 

I is likely io happen during th# next -4,, S i* t r V 

' fc., rr > & CAt population rhive these characteristics, 

ten or twenty years are being made- 

In addition to trends of what is ex= 
pected'to happen on the basis of what 
has, happened in the past, extra de- 
mands for persons in times of emer- 
gency, are also being estimated. In 
trying to peer into the future the 
.Commissi Sn has been interested in 
tracing realistic demands rather than 
i setting up arbitrary, perhaps unreal- 
istic suggestions as to "What ought to 
happen*" 

In presenting this rather brief out- 
line of the things the Commission on 



and the reasons why some of them go 
into fields in which we are interested 
while others do not. Thirdlv ? we must 
evaluate the future demands so that 
we can determine how many of the 
potentially able persons should be 
trained and can reasonably be expect- 
cd. to he trained, 

Fhescp problems are so interrelated 
that they seem to us to be a single 
problem. And that is precisely the 
reason why we have undertaken to 
work on all three at the same time, 
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STRETCHING THE SUPPLY OF HIGH L^EL TALENT 



It is becoming increasingly apparent 
in these days of world crisis that one 
of our national resources in shortest 
supply is the .supply of high • level 
talent, It would seem that the supply 
of such high level talent is grossly 
inadequate to fill the 'mobilization 
demands placed upon U . by industry 
and the defense agencies and still 
meet the needs of our society for the 
civilian leadership necessary for its 
continuance as a free and dynamic 
way of life. However 5 it >s,^ot neces- 
sary, to accept this^ defeatist point of 
view if we realize that the supply of 
high level talent need not be regarded 
as a static supply, As with many 
other national resources it should 
be possible through proper research 
and management not only to increase 
the efficiency of utilization of the 
supply presently available hut also 
to increase the total supply. One of 
the primary missions of personnel 
research today should be the accom- 
plishment of this objective, 

The supply of high level talent will 
be in part a function of the number 
of relatively independent dimensions 
of^individual differences that are 
generally accepted as significant 
talents, For example* We might de- 
fine "high level talent" as being in 
the top X per cent of the general 



population in any dimension or set 
of dimensions of individual differ- 
ences that are generally accepted as 
being important* in human affairs, 
By this definition the supply of high 
level talent could range from X per 
cent to near 100 per cent of the gen- 
era! population depending upon the 
number and intercorrelations of the 
accepted dimensions of talent. It can 
he seen from the above that the so- 
called "supply" of high level talent 
may be increased hy any one of the 
following procedures: 

A, Increasing the precision with 
which we can identify and measure 
differential dimensions of relevant 
individual differences. 

B, Increasing the number of inde* 
pendent dimensions of talent by 
re-defining tasks or jobs in such a 
way as to minimize the number of 
relatively independent dimensions of 
individual differences involved in 
success in each task or jc*b, 

C, Increasing the efficiency of 
training in order to minimize the 
magnitude of the "critical amount" 
of talent necessary for success in 
each task or job. 

D, Insuring rriat each individual 
in the population has a full and 
adequate opportunity to develop and 
use whatever latent talent and poten- 
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tial for developmenl that he may 
possess* 

Much' of the military and Indus- * 
trial personnel research of the past 
.decade has been oriented toward one 
of the first three objectives above. 
It is felt that the fourth objective, that 
5 f insuring that each individual in the 
population has a full and adequate 
opportunity to develop and use what- 
ever latent talent and potential for 
development that he may possess, 
falls more properly, within Hue do* 
main of the educators and social sci- 
entists. However, it is believed that 
the personnel psychologists should 
realize that the achievement of this 
fourth objective might do more in 
the long run than theft own efforts 
to stretch the supply of high level 
talent: Accordingly they should lend 
every possible .assistance and en* 
couragement . to 'tM research efforts 
of those active in thoj field. 

Most of the military research ori- 
ented toward stretching the supply of 
high level talent falls within the areas 
of personnel selection and^dassifica^ 
tion, jqh and quaHficaUons^uaJysis, 



dimensional (general intelligence for 
example) the supply of high tevg^ 



talent will be X per cent However, 
if talent is regarded as existing in 
two independent dimensions, then 
the supply of high level talent be- 
comes X per cent plus X( 100 X) per 

100 

cent -or very nearly 2% per cent if X 
is small as would usually be true. Of 
course the increase becomes consider- 
ably less if the two dimensions are 
correlated. The supply will be asymp- 
totic to 100 per cent as the number^ 
of" independent dimensions becomes % 
large, and even with moderately cor- , 
related dimensions the supply can i 
become relatively large with a reason- 
ably small number of dimensions. 

Here it should be pointed out that 
the supply of talent is related both to 
the number and iutercor relation of 
dimensions of relevant individual 
differences in individuals and also 
tojthe number and intercorrelations 
of these dimensions involved in each 
job or task. For example, if talent be 
regarded as existing in two dimem 
sions (Let us say general intellectual 
Mining research and human /ngin- .^aptitude and physical status) then 
eering. Relevant aspects of fi. re- .{he supply of talent available to Ml 
search will be commented oil later the existing high level jobs could be 
under these four categories. \ ^as low as X per cent multiplied by 

f X per cent if each such job or task 
required that the Incumbent be in 
the upper X per cent in each of the 
two dimensions of talent, Thin is 
not a mere hypothetical illustration 
since the armed forces frequently 
require both high physical and in- 
telieetual status for many assignments, 



Let us now return to bur original 
definition of talent as being ^the 
top X per cent of the general popu- 
lation In any dimension or set of 
dimensions of, individual ' differences 
that are generally accepted as im- 
portant in human affairs, We dan 
sec thirt if talent Is regarded as uni- 
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The reasons for this are, obvious and 
are usually justifiable. However, it 
should/be realized that thi;> seriously 
reduces the supply of higr level tal* 
. en_t» availaWfe to the armed lorees and 
should be avoided except wpere abso- 
lutely necessary, 
/it would be well at thip point to 
look into the question of j the prob- 
/able number of independent dimen* 
/ sions of talent, While the p umber of 
/ independent dimensions of talent is 
probably much smaller I than the 
number of orthogonal factors possible 
to isolate and rotate, there is good 
evidence that talent doeslexist in at 
least several fairly independent di- 
mensions. Among these! a PP ea ? *° 
be* Intellectual aptitude,! mechanical 
aptitude, physical condition, pereep- 
tuabmotor aptitude* motivation and 
interest factors, and temperament fac- 
tors. Each of these afeas may, of 
course, be resolved iijto numerous 



sub-dimensions, many pf which 'may 
be relatively independent. Consider- 
able success has been Idealized in de- 
veloping comprehensive classification 
test batteries consisting of tests repre- 
sentative of eaoh of the above six 
areas. Such batteri ef are now widely 
utilized in the varidus armed forces 
and by industry, fTo the extent to 
which they yield differential rneas= 
ures of the variqus dimensions of 
talent they increasjS the available sup- 
ply of high level, talent as <5ontrasted 
to the older dayft when talent was 
identified largely jfin terms of general 
* intelligence. It snould be pointed out 
that the efficiency of most existing 

I ■ n 



classification test batteries should not 
be overestimated as. most of their dis- 
crimination is in the intellectual and 
mechanical areas, Generally the 
agencies utilizing them are well awfre 
of this and are concentrating a large 
portion of their research effort upon 
improving the coverage of their bat- 
teries in the other areas. 

The classification test batteries 
yield information making it possible 
to identify the high level talent with 
greater precision and to increase the 
available supply. The problem still 
remains o*f achieving optimum effi- 
ciency of utilization ?of the supply 
identified. This is the so-called 
""classification" problem as recently 
defined by Thorndike, /The solution 
.to this problem consists of selecting/ 
the man- job assignment configuration 
that yields the highest productivity 
sum for the group involved, Consid- 
erable work on this problem has been 
accomplished by the armed forces 
and several possible mathematical 
solutions have beer^ developed # and 
are being tried out experimentally in 
empirical studies, They show promise 
of aiding the armed forces to achieve 
optimum efficiency of utilization of 
their limited supply of high level 
talent. 

Recently the armed forces have 
completed several interesting studies 
of the intercorrelations between cri- 
teria of training success in various 
job areas. It has been found that 
such criteria as technical type school 
grades for different jobs often show 
a disturbing amount of common 
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variance* It is to be doubted that 
this always reflects a true overlap in 
the talents involved in actual job 
productivity in the different areas* 
There is good reason to believe that 
^ much of this overlap may be an arti* 
fact of the grading systems which in- 
clude many written achievement tests 
and of the curricula which involve a 
considerable amount of verbal and 
written subject matter. Classification 
test batteries ^are usually validated 
against these school grades and are 
thus severely limited in the amount 
of discrimination ' that they can 
achieve between such criteria. The 
three services are acutely aware of 
this limitation and are making strenu- 
ous efforts to develop usable criteria 
of on-the-job effectiveness. 

This type of spurious overlap be- 
tween school grades may cause inef- 
ficient usage of talent in still another 
way if there is an appreciable amount 
of attrition on the basis of school 
success. This will be true to the 
extent that the spurious overlap in 
* such factors as verbal faeililty for 
example are not involved in the actual 
performance on the job, 

In addition to the problem of 
stretching the supply of high level 
talent the nation also faces the equal- 
ly acute problem of stretching its 
supply of low level talent. In this 
connection, low level talent may be 
regarded as those cases where X per 
cent of the general population repre- 
sents a relatively high percentage but 
one that is definitely less than 100 per 
cent, Examples of such talent might 



be artisans, non-technically trained 
enlisted men, etc. It is not believed 
that the problems regarding low level 
talent are qualitatively different from 
those regarding high level talent. The 
same basic principles for stretching 
the supply of high level talent should 
• also apply to stretching the supply 
of low level talent. If anything, the 
results of the application of these 
principles with low level talent should" 
be even more pronounced than for 
high level talent since the low level 
jobs are usually less jpt to require 
a number* of separate taients. 

Perhaps the most promising meth- 
od of stretching the supply of high 
level talent is by increasing the num- 
ber of independent dimensions of 
talent by reddfining tasks or jobs in 
such a way as to minimize the num- 
ber of independent dimensions of 
individual ^differences i^olved in 
success in each task or job. This is 
often referred to as work or job sim- 
plification. An eminently successful, 
example of this is the platoon syjtem 
in football. Not only do the players 
usually specialize in offensive or de- 
fensive play, many also specialize to 
the extent, for example, of only hold- 
ing the ball for extra point attempts. 
This has undoubtedly raised^ appre- 
ciably the average level of skill dis- 
played in each of the elements of 
modern football play. Under the old 
system of relatively non-specialized 
players the supply of high level foot- 
ball talent was much mo|C limited 
than today. In those days a boy 
might have considerable talent in 
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catching passes* for example, but be 
tqo light to play defensively. Another 
might have , considerable talent for^ 
defensive line play but be relatively 
weak* at offensive play ( perhaps be** 
cause of lack of speed* Still another 
might be very talented as a punter 
but be weak at all-around play either 
offensively or defensively. By meani ? 
of job simplification the supply of 
high level football talent' was appar- 
ently greatly increased/ 

This matter of job specialization is 
, of urgent importance to the military 
and lies at the heart of many of their 
personneb problem^ However, the 
answers no these problems are not 
easily ^achieved, The nature of the 
military situation is often not very 
appropriate for the type of frse sub- 
stitution that permits football or in* 
dusfcry to go so far in the direction 
of specialization. In combat -ihere is 
no time out between plays anfi often 
the space on a ship or in an aircraft 
severely limits the size of the crew. 
Thus each crew member must, be re- 
sponsible for a variety of types of 
duties and also be able to take over 
many duties of other crew members 
in emergencies. In addition a high 
degree of specialization creates tre- 
mendous administrative p r o b le m s 
where personnel frequently have to 
be transferred from one organization 
to another* However, because of con- 
cern over the limited supply of both sponsoring considerable fundamental 
high and low level talent, the services investigation into the nature of the 
are carrying out research on job learning process itself especially in 
simplification in order to permit the such areas as motor .and perceptual 
maximum use of specialists under the "learning, All of this research should 
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limitations within .which they must 
operate. 5 

Closely related to the w^ork on job 
simplification is the work on human 
engineering^ . In this area one of the 
basic problem^ is to determine how 
to design .equipment etc, in such a 
way as to minimize the complexity of 
the task of operating and maintaining 
it, To the extent to which they ac* 
complish this purpose they minimize 
the number of relatively independent 
dimensions of individual differences 
involved in success in the tasks or 
jobs based on the equiptnent and 
thus aid in stretching the supply of 
hjgh< level talent. 

As pointed out earlier^nother way 
6f stretching the supply of high level 
talent is to increase the efficiency of 
training in order to minimize the 
magnitude of the ^critical amount* 7 
of talent necessary for success in each 
task or job. The armed forces are 
highly aware of this and are investing 
heavily, in research aimed at increas- 
ing me efficiency of training, A large 
amount of research is now 1 " underway 
in determining the optimal methods 
of utilization of such training aids 
as synthetic trainers' films, mock-ups, 
and even television, Further work 
is directed toward the area of train- 
ing methods, improving the quality of 
instructors* etc. The services are even 
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that this .' cannot be accomplished 
merely by raising the correlation be- 
tween tht selection standards and 
training success if this is accomplish^ 
ed, at the expense of increasing dis- 
proportionately the porrelation be- 
tween the selection standards for the 
various jobs competing for the same 
manpower, 

^^The equipment and mainten- 
ance procedures could possibly be 



assist greatly in stretching the supply 
of high* level talent, 

Let us now look at a ease history 
of a hypothetical high^lexel job for 
which talent is in short, supply and 
see how we might apply the above 
principles ( to stretch th* supply of 
talent for the job. We will suppose 
that the job consists of maintaining 
equipment Y which is ve^y intricate 
and difficult to maintain. Typically r 

we might encounter the/ situati^ redesigned to simplify maintenance 
where 1 the selection standards for ; pYohlems without loss of operational 
entry into training for this job. are ^ejficieney^ 

quite high and yet^he.e is still * a ^ %~ Improved, training devices aud 
high elimination rate during the , procedures could make it possible * 
training course. It is found that if to graduate a higher proportion of- 
the present selection standards are* students without raising entry stand, 
raised it will not be possible to fill ards or decreasing on-the-job pro- 
f the training quotas and still meet 
other equally* important training 
quotas requiring similar talent, What 
ab needed in this situation^ are pro- 
cedures which will reduce the elimi- 
nation rate during training without 
decreasing trie supply of talent avail- 
able for other commitments and with- ample, 
out reducing the efficiency of the 5. It might be possible to redefine 
graduates on-the-job. It il believed the job and divide "the duties into 
that any one or combination of the two separate jobs each requiring a 
following procedures could help ap* lower level of talent than the original 
preciablyio accomplish this objective job, or it might be possible to rede- 
and thus stretch the supply of high fine the job in order to have one high 
level talent. l> v< l man with two more specialized 

1. If the differential validity of and lower level assistants do throbs 
the classifioarion. procedures is in- originally set up for three high level 
creased it will be possible to lower men. . 

the training elimination rate without 6. Finally by better management 
decreasing the Supply of talent re- and administrative procedures . we 
maining for assignment to other high may decrease the total personnel at 
level jobs. It should be pointed out all levels necessary to keep the equip- 



hciency. 

* 4, The training curriculum could 
be revised to eliminate all elements 
not directly contributing to on-thegob 
proficiency. In some cases it might 
be possible to decrease the emphasis 
in theory and mathematics, for ex- 
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ment maintained thus decreasing the that apparently can he -stretched eon- 
drain on the manpower supptj('. siderably as the , result of research 
In 'conclusion, it may be reiterated now underway in both military and 
that the supply of fiigh level lalentf civilian, personnel research programs, 
is not a static supply but a supply ■ s 
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SOCIOlOGICAL AND' PSYCHOLodlCAL FACTOR! 
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This Mb distributed over 
tljlS diitiro' s^io-econonyq^ip@^i but 
i^Tit 4 it in ' the 



By" Talent, let . us mean very high 
5 abiHty in spine Socially valuable area. ^ .-y 
The^lare many • socially valuable' there is relatively more* 
areas^ ' including such' diverse ones^ Upper reaches, ©f4% top fifth ,of 
as abstract thinking tennis playing^ tin- population, in verbal kaejiigence, 
leadirship^ and salesmanship. But 
for ihfe'sa^e off this discussiori let us 
^iiiiit , oursjFver to intellectual and 
artistic ardas. ■ 

How high must ability be*%hen 
we'eall it talent? For the purpose of 
this discussion let us eonsi^r^two 
levels of ability/ By talent * let us" 
mean the upper two per tent, and by 
high pbility the upper twenty per cent. 

Sociological Factors Affecting, 
the Supply of Talent 



approximately halt eomelfrom the 
upper .third on tpe socio-economic 
scale, while the othlr half 5/omeS from 
the lower two-thirds, which is "often 
called thc^ working/class* 

It is not certain whether jhere is 
an even vgreatjpr segregation of very 
high verbal intelligence by soci.o- 
econbuiid status^ Termaji, in his Ge- 
netic Studies of Genius, which dealt 
with children in the upper one or 
.two per cent of ability, found a very 
high, proportion of them to come 
In order to discuss the supply of fp in the higher socio-economic leveU, 

but iiis procedure for selecting talent 
may have overlooked some at jthe 
lower socio-economic levels* 
g Turning, to musical and artistic 



talent we must make some rfssum t 
Hons concerning the visibility of 
talent. We may assume \t\fs all in 
sight and jthat we can feegguize it, 
or we may assume that a^iemlsiderahle 
part of the supply of talent is not 
readily visible to us. 

The Distribution 4) f Talent 
Among Social Groups I 
" Confining our attention at first to 
falent vfchieh is visible we may in- 
quire into its distribution among vari- 
ous social groups. First let us con- 
sider the kind of talent which is in- 
dicated by high verbal intelligence 
as measured by 4 the ordinary intelli- 

■ ■ f r 24 



talent, the distribution does not seem 
to be related directly to socio- 
economic., status. Musical talent ap- 
pears to be related to cultural back- 
ground—the Italians specialize in 
grand opera, jews in pianists and 
violinists, Negroes' in singers, and 
American Born composers in jazz, 
Jews have been unusually {Productive 
of all kinds of artistic talent, as- well 
as of high verbal intelligence, * 
There are some sex differences in 
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the distribution of artistic talent s 
^with men showing more very high 
Jfvel records* It is interesting to note 

* that the great musical composers have 

* been men, almost without exception. 
Men have provided most of the gye&t 
painters and poets, but women 'have 
eeme* much-* closer to men as great 
actors s singers, and novelists, 

, , The knovVn distribution of visible 
s high level intellectuaj and artistic 
talent can he explained on the theory 
that* each social group possesses cul- 
tural habits apd attitudes that tend 
to bring out certain kinds of talent 
and to suppress others, 

about talent that does not 
come to light? There are two poss|* 
ble reason i for d talented person go- 
ing undiscovered. One reason is that 
the tests^ or other means used to dis* 
cover* talent are inadequate. InteHf- 
* : gqncfc' tests certainly fall somewhat 
short of iheasuring intelligence |tn>aU 
ly well all socio-economic groups. 
Allison Davis has found with his ^ 
new "jculture-fair" test of intelligence 
that some slum*dwelling youngsters 
who appear to have about average 
intelligence on the usual, tests actually 
show a very high level pf intelligence 
on the pew tests, We have nq good ■' 
,way of estimating the amount of Un- 
recognized talent due to inadequate 
tests* Certainly a great deal of artistic 
and musicgl talent goes unrecognized 
because the tests of musical and 
artistic aptitude are inadequate. 

The secoftd reason for talent not 
coming to light is that it may be 
suppressed—not permitted to develop 

r. 2s 



— -by a poor environment. The geneti- 
cists telh us now that every human 
characteristic which has a hereditary 
basis is influenced in its actual ap- 
pearance b^the environment Talent 
probably no^ds two kinds of environ* 
mental encouragement Jos it to de- 
velop.. First, the individual needs food 
and physical care and character train- 
ing ai a child so as to grow up with 
normal physical energy and enough 
self control and self assurance to be 
a purposeful, hi dependent humajjpbg- 
p ing, Seconal,* the individuar needs a 
social environment which teaches, him 
to exercise hjs talenl and rewards'him 
for it, 

•.. Probably a relatively great airjounj 
of= talent is suppressed by efivirpn- 
ment tjiat fails to stimulate and re- 
"ward its development especia|lf^in 
the economically unuerprivileged 
groups such as American Negroes 
and Mexicans. $ 

Thus* , if we accept the idea that 
talent or ,the potentiality of d talent 
exists without being obser\jed, the 
writer believes that the known facts 
about talent are best explained by a 
theory that the potentiality for talent 
is inherited with little on no group 
differences among the races and so- 
cial gnrfjps of mankind, and that the 
appearance and development of talent 
in individuals is a result of environ- 
mental stimulation and guidance s If 
this theory is accepted, then any 
social or racial group which does 
not display many talented individuals 
may be presumed to provide a social 
environment which does not stimu* 
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'late the development' of talent. Thia sodal expectation, or whatthe family 
is probacy Ae leason that women and the society exp<*ts #M*«nj in- 
r / seem.» to show less talent than men 



Sjl ! e jR^ioi«odigAL FACT5RS Affecting 



|[HE|Supply of Talent 



„ ..ie ,* principal factor within the 
fadividuak>hich affects the suriply 



dividual motivation, or what his own 
life foals are; financial ability, in 
^relation to the cost of continued edu- 
cation; propinquity to amedueatioual 
institution. This proposition can be 
.put into the form of a mathematical 



jidividualt^men anecis me siw*?, Equation: 

oUaienl is motivation, Motivation/, a x niental ability + b X 

frriiecemry to the developmental social expect ation + c X individ- r / 

.'intellectual or artistic talent^the mo- ^ . motWation + d X financial % 

tivation being a desire to seek-tram^ . ^ ^ ^ propinquity, ' - 

ing and a willingness to saenfice, ^ J probability that John ' 

other des.es whUe undergoing of Ruth Roe will go on to a 

ing. Lack' of motivation appear, to » in9t itiitiOn of learn- 

be the principal reason why v»ibk b are CQn . 

talent is not trained and developed g ; * --- j . - J 

in this country. Lack of motivation * iamb lJ --- ' r , 

in mis iuum-jr. B tudie* of boys and girls in the United 

appears to be more powerful than siuuit. o. >- b 

lack of money in reducing the supply States. - 

~~ i . ■ - Mental Ability,— k half-dozen recent 

ot talent* . * - _ ifl , , e - ' 

To explore the motivation factor studies indicate that 40 to 45 per 

further, we may concentrate our a. cent of boys and girls ,n the upper 

tention on the question of going to ' fifth of the population as measured 

college Talented youth who do not by ordinary intelligence tests go to 

go to college are not likely to get the college. The actual proportion vanes 

Lining that will enable them to from one type of community to an- 

develop their capacities to' the point other, but remains between about 35 

where they will be of most use, so- and 50 per cent, 

dally- Most vouth with visible talent As we go up the scale of intellect 

finish high school. But a considerable tual ability we find higher proportions 

number of them do not go on with of youth entering college. Phoarman 

formal training after high 'School, found that 02 per cent of the top 2 

Hence it is well to focus attention at per cent pf Iowa.htgh school seniors 

this critical point, (measured by the Iowa tests of Edu- 



Ifhe 1'iobuhility of Going 
to College* 



* The following pflgei are taken from 

( a memorandum prepared by the writer for 

„ the Commission on the Ftaneing of Higher 

The probability that a given boy Education. The complete memorandum is 

' , „ j i „ in be Duhlished aa an appendix to Who 

or girl will go to college depends on *^/g 0 To Coll€ge? £j Byron s. Hob 

the following factors: mental ability; Hnghead, and published by the Cfemmusion. 
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catipnal Development) went on to col- 
lege* Terman found that 90 per cent 
of his gifted group entered college 
and 70 per cent graduated* Goetsch f 
with data from the depression decade^ 
found that 63 per cent of Milwaukee 
high school seniors with IQ 140 and 
over entered college, while the pro- 
portion dropped to 22 per cent of 
those with IQ in the 117*119 range. 
s The Phearman ancL Terman figures 
appear to tbfcjVriter to suggest too 
high an estllflte of , intellectually r 
talented youth * goirig ^ to ebllege, 
Fhearman's and Goetsqh's figures 
must be reduced by the group (a 
small one) of talented youth who did 
not finish high school, Terman's 
group probably had an unduly high 
representation of children of higher 
socio-economic status, who woulp! be 
more likely to go to college because 
of social expectations. ^ 

It is probable, howler, that at 
least *75 per cent of youth of very 
high intellectual ability enter college* 
and 60 to^/0 per cent of such youth 
finish a jfour^year college course. 
Social Expectation or Social Motiva- 
tion.— If a child grows up in a family, 
which expects him to go to college, he 
is very likely to do so, Since family 
attitudes toward education ; differ 
systematically from one social , group 
to anothnr, we can predict that young 
people from one social group will 
very probably go to college, while 
young people from another group 
will be very unlikely to go to cob 
lege, 

The ^^al groups nrost likely to 



send their children te college are\the 
urban business and profesional pep* 
]ple. Those least likely ^to expect their 
children to go to college are the 
urban * working-class group' and the 
small-scale farmers, " \ 

The most useful social erassification 
of people in terms of their attitudes 
toward higher education is the socio- 
economic classification of Warner* 
. A simplified version of this is the 
following, 

a. Upper trig] Upper Middl^Cluss,— 
Providing about ten per cent of the 
children, this group sends about 80 
per cent 5f 'its children to: college. 
Those who do not go to college fall 
into twa groups: (1) the daughters 
of upper class families who terminate 
thei^ formal education with a /"finish- 
ing school" of high school level and 
(2) the children whose mental ability 
is too low to permit their success in 
any kind of post high school institu- 
tion, 

b. Lower Middle Ci^s.^-This^grourr 
consists of white cokfkr city workers, 
people in semi-professional occupa- 
tions, small business owners, 3 highly * 
skilled artisans, foremen, and owners 
of "good" farms. They produce some 
30 per cent of* the children. Approxi- 
mately 25 per cent of these boys and 
girls go on with post high school 
education, Thus it is the exception 
rather than the rule for a lower mid- 
die class youth to go to college, The 
expected thing for him is to graduate 

Som high school and go to work, No 
. oubt more boys and girls of this 
class would go to college if they had 
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scholarship aid, for the economic 
means of a typical lower middle class 
family would not permit sending a, 
child away to college, Nevertheless, 
financial need is not the sole barrier 
to^colleg^going; there is also a con- 
siderable barrier of social expecta- 
tion and a barrier of individual moti* 
vation. ... 
c. Working Class. — This group— the 



eighth as largp a percentage «f Negro, 
as of white youth of college age were 
enrolled in Higher" educations Thip, 
however v is largely due to socio; : 
economic differences between Negroes 
and whites* " v 

Ethnicity is ^another social factor 
of some consequence, In' Connecticut 
49 p&r cent of high, school graduates 
of Italian origin applied for college'*' 



upper Jower and Idwer lower Glasses ^compared with 57 per cent^pf Catho^ 
in Warner's temiinology— consists of ^Hcs 3 63 per cent' of Protestants, and 
unskilled, semi skilled, and some 07 per cent of Jews * Here it . seems 
jkilled urbk workers, most farm ten. that £talian ethnjo background re : 
'ante* and all share croppers. duceJ probability of going to college, 

per cent of. the chfldxeBin the Bnjieii whifc Jewish background (it we may 
States comev from this grotfp, Less call this ethnicity rather than relig- 



than five per cent* of these children 
|go beyond high school in . their edu- 
cation. It is even unutual lor boys 
and girls of working-class families to 
finish high school The majority of 
tftem drop out of school at the legal 
school leaving age. There is a strong 
social expectation in tfie working class 



iorfc} favors going to college. Here, 
too, the socid-econornij factor was 
certainly a 'large element. 

Urban; residence implies a slightly 
greater social expectancy of going 
to college than rural residence. There 
is a slight and probably decreasing 
tendency for farm families to be less 



that a boy or girl should quit school favorable than city .families of the 



and start to work and earn money as 
soon as he is able to do so. The 

.idea of going to college is not a 
popular one in .working class circles. 
A boy or girl must surmount a barrier 
in the social expectations of his 
friends and netftbors and his family 
if he goes on Beyond high school. 
Other Classifications— There are sev- 
eral other ways of classifying people 
with regard to social expectation of 
going to college. Color, is one. The 
work of the Newark State Tejnpor* 

: ' f ary Commission on Need, for a Sjate 
lUniversUly showed that :only one* 



same socio-economic level toward 
higher education for their children. 
However, the principal factors reduc= 
ing college attendance of rural child- 
ren are, socio-ecotioniie and distance 
factors. -\. 

individual Motivation. Whatever 
the social expectations that press on 1 
him from without, the individual has 
within himself a set of purjJoses which 
may or may not include a desire for 



* Sieiler, Henry G. "College AdmiBsion 
Practices with Respect to Race, Religion f 
and National Origin of Connecticut High 
School Graduates,** HartfordyuConnectieiit, 
State Interracial Commission, 1949. 
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higher education, **If he has such a 
desire, and a strong, one f he will sur- 
* mount social and economic ba^riars 
to get into college; if he has litfie 
individual motivation,^ he will vbt 
get into college unless he is pushed 
strongly. i ■ 

For example, a boy whose father 
was a janitor* . whose mother and 
&• father had not gone beyond the 
eighth grade in school, was so, imbued 
with the ambition for higher educa- 
tion that he wrote, at the age ol 16, 
"The worst thing that could happen 
to me is that I should fail in my plans 
to go to college and enter into a pro- 
fession. 55 He secured a scholarship 
and went on to college. On the other 
hand* a boy whose parents had a 
small business and wanted their only 
son to go to an engineering school, 
refused to do so and took a job as 
clerk in a store in his home town, 
saying that all his friends were in 
town, his girl friend was there, and 
he liked working in a store. So why 
should he go off to college? Both 
boys were intellectually superior but 
the factor of individual motivation, 
determined which one should go to 
college. 

Carson McGuire in his study of 
adolescent social mobility* identifies 
three groups that have the individual 
^motivation to go on to post high 
school education. They are: 
1. The high status static. -This is 



* McGuire, J, Carson, "Adolescent So- 
ciety and Social Mobility*" Unpublished 
Ph.D. Dissertation, The University 
Chicago, 1949, 



of 



a person "of upper or upper middle 
socio-economic , level, /who .has the 
typical educational attitudes of his 
social group. Though not upward 
mobile* he will go on to t college Up 
cause that is normal for his group* , 

2. THe climber.— This is a* lo-we 
middle qr a working class p youth who 
has a solid "and realistic ambition to 
*%et ahead" - in life* This .person has 
friends among boys and girls of high- 
er social status, spends time in their 
homes, dnd absorbs their educational 
attitudes. He Has a good mind, a * 
strong personality, understands that , 
self-control and hard work will be 
required of him, 'and is prepared in- 
ternally to make the sacrifices neces- 
sary for the -achievement of higher 
education ^a^d consequently social 
mobility. 

3. The straindr* — This is* a lower 
middle or working class youth whose 1 
goals in life are mixed* and whose 
own personality is vacillating, He 
wants to "make good," ,yet s is not 
completely sure within himself 'What 
tli is means. He makes friends with 
boys and girls higher on rhe social 
ladder, but is never quite sure that 
he desires their way of life. In the 1 
end it is something exterrrai to him, 
such as a GI Bill of Rights, that 
decides whether he shall go on with 
his education. * ' 
Financial Ability. — To a considerable^ 
extent the ability to pay^for a col- 
lege education is * systematically re* 
lated to socio-economic status. The 
upper' and upper middle groUpy-ean 
afford to help their children *get a 
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higher education though sometimes at greater in communities with colleges 

a considerable sacrifice, especially if than in communities without colleges, 

the number of children: in the family This is du/parUy to the financial ad- 

i % large. Jot the lower middle group , vantage of being able to, live at home 

it is a great financial burden to send while going on with one's education, 

even one child away to college, though and also due to the fact that the goal 

it is possible to support a son or of higher education is more familiar 

daughter in a college; at home, es- and more attractive when it isWisible 

pecially if it is tuition-free. Further- in the home town, Youth who would 



more, the student is expected to con 
tribute something through working 
during the summers, For the work- 
ing-class group there M little possi- 
bility of financial help from parents, 
except where there is only one child, 
or only one child in the family is 
going to cojjege. Furthermore, the 
loss of the earnings of a youth who 
is going to college instead of working 



not make the effort to go away to 
school will Continue their education 
if school is brought to them, as it 
were, The social expectation of go- 
ing to college is increased in a col- 
lege town, ^ 
Summary of This Theory ,— To apply 
-this theory of the determining factors 
of post high school education, the 
writer has drawn up a' kind of para- 



11 going iu uuiicgc v* . v»_i 

1 is "Wit keenly by >uch a family. Ac 'digtn in the form of a table which 



i cordingly, most young people in this 
^ group who go to college must sup* 
/port themselves almost completely, 

through employment or through 

scholarship grants. 

Propinquity, — The percentage of 

"youth going to college is usually 



combines three of the five factors. 
The other two factors are kept con- 
stant in the case of a particular table, 
These constant factors are propin- 
quity to an educational institution 
and mental ability, 4 



TABLE L 

Probability of Going to a 
Post High School Institution, for 
Youth of Superior Mental Ability 
Probability levels are indicated in the respe ctive, cells 



Soeio- 
' Economic 

Status - jj 


Low 


=j£ ^ = 

Medium 


High 


High 

(Upper & Upper 
Middle) 


3 

Doubtful 


High 


i 

Very, High 


Medium 

(Lower -Middle), 


6 

Low 


5 

Doubtful 


4 \ 
High 


Low , 
('Working Class) 


9 

Very Low 


8 

* Low 


7 

Doubtful 
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Table 1 shows the probabilities of 
going to collage for youth of superior 
mental ability, Cells number 5 and 7 
are especially important because they 
contain relatively large numbers of 
* people* For those in the upper 2 
per cent of mental ability all of the 
probabilities should be increased 
somewhat over the levels indicated in 
Table 1. However, even for this 
group of outstanding intellectual 
ability there are sure to be individuals 
in cells 6* 8, and 9 with low individual 
motivation or low social motiva- 
tions .who will not go to college. 
Application of This Theory, — The 
writer has applied this theory to two 
age-groups in a small mid western city 
where the necessary data were . avail- 
able. The theory worked, quite well 
to predict the proportions of youth 
of superior ability who continued 
.their education bejjpnd high school* 
The following examples illustrate 
high and low motivation in relation 
to college-going. 

Some Cases* of High Motivation* — 
A was a boy in the 1926 groups cell 7, 
IQ 12?, the son of a widow, his father 
having been a factory worker, A was 
a faithful attendant at Sunday School 
where his teacher, a professional man, 
took an interest in him and encour- 
aged him to plan for college. His 
pastor did likewise* They recom- 
mended A for a scholarihip to a 
church-related college and their rec- 
ommeridation was supported by the 
high sehodl faculty who held a high 
opinion of A, A's mother worked to 
support herself and could not help 
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him, A went off to college and was 
inducted into the armed services after 
about a year of college work* When 
he was discharged he went back to 
college on a GI scholarship and later 
attended a professional school Ab 
though the GI scholarship was a great 
help to him* there is no reason to 
doubt that A would have worked his 
way through college if he had found 
t this necessary. , 
B was a girl ih the 1932 group, 
cell 4^ IQ 143, one of four, children 
in a lower-middle class family* Her 
father operated an automobile service 
station, Her mother, though not a 
college graduate, was much interested 
in school affairs and was active in 
church and women's club work* Even 
though it meant a considerable sacri- 
fice for them, they determined to give 
B a college education* and they made 
their decision as early as her fresh- 
man year in high school. B was al- 
ways quite sure that she would go to 
college. She was encouraged in this 
ambition by her teachers and her 
school grades were in the upper tenth 
of the class* thus giving her some 
reason to Hope for scholarihip aid* 
She went joff to college as a matter 
of course, though not one of her five 
or six close friends did so. 
Some Cases of Medium Motivation, — 
E was a boy in the 1932 group, cell 
5, IQ 139, whose father was a master 
plumber. Though neither he nor his 
wife had gone beyond high school, 
they wanted their only son to go to 
college. This they urged on E for the 
last two years of his high school 

1 
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career. They could afford to, pay hftf 
expenses. They talked with the high 
school teachers and asked for their 
help in persuading E to go on with 
his education. But E merely shrugged 
his shoulders, He had a part-time job 
as clerk in a food store, and he liked 
this kind of work* Besides, he said, 
"My friends are all going to stay in 
town; my girl friend is here; I like 
this place. Why should I leave it?" 
At last accounts E was doing very 
. well in his full-time job in the food 
store, , » 

F was a girl in the 1932 group, 
cell 5, IQ 134, the most talented per- 
son in her class, Her parents had 
neither of them graduated from high 
school, but they wanted their oldest 
daughter to do what was best for her. 
They had a small business and told 
her they could help her substantially 
if she wanted more education. They 
did ryot urge her to go to college. 
For a time she thought of going to a 
music school for she had enough 
musical ability to justify encourage- 
ment from her high school music 
teacher, F was always in the lead 
of things in school, a great organizer, 
quite popular f She played the cole 
of idea-giver in her age-group. She 
promised to be a leader wherever 
she might locate herself. To the sur^ 
prise of her teachers she took a minor 
office job at home, making no effort 
to get into colleger* Before the end of 
the year of her high school gradua- 
tion "she was married, ' 

G was*. a boy in the 1932 group, 
cell 8, IQ 123, who as early as his 



tenth year, showed remarkable visual 
imagination on tests, and was diag- 
nosed by a psychologist as a boy who 
might make, an outstanding architect 
or/ mechanical- engineer—one in a 
..thousand. G's father was a factory 
hand—neither he nor his wife, had 
graduated from high school They had 
t .one other child and could have helped 
G substantially with college expenses, 
G was no more than a high average 
student in the verbal subjects of the 
high school curriculum, but in me- 
chanical drawing and shop work he 
was remarkable/ G had two good ' 
friends neither of whom planned to 
go to college. For a time he thought 
of going to a school which trained 
draftsmen, but he ended by taking a 
job in in automobile service station, 
The Role of Motivation 
For boys and girls in the upper 
fifth of the population in general 
intelligence it appears that about, 4 
out of 10 go to a post high school 
institution, another 4 out of 10 do 
not go because "they lack ' sufficient 
motivation, and 2 out of 10 woulJ 
go if they Had liberal financial assist- 
ance, This is the conclusion from a 
* survey of recent studies of the reasons 
given by the abler high school gradu^ 
ates for, not continuing their educa- 
tion. However, most of those who 
lack motivation also lack financial 
means, and they would need financial 
help if their motivation was changed 
to cause them to wish further train- 
ing. 

For boys and girls in the upper 
2 . per cent in intelligence there is a 
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much larger nroportioii^ in college— 
possibly aifmatay as 7 or 8 out of 10, 
Conclusions 
This treatment of the motivational 
fafctor a* it aflects the supply of talent 
indicates the great importance of mo- 

a tivation for higher education in deter* 
milling the sjrpply of "high ability" 
(upper fifth) [people who take college* 
level trainingj Apparently the motiva* 
"tion fodoouege training is much 
greater among the top 2 per cent of 

>the population than it is among the 
top 20 per cent. However, the data 
to establish this point exactly are 

^unavailable: Thewritef ineliiies'to 
trie view that even in the top 2 per 
cent there may be as many as a third 

<, of the group who do not seek college- 
level training. 

Finally, jt should be noted that the 
studies of who goes to college are 
based primarily on measures of talent 
which (1) may overlook a good many 
people of high artistic ability * (2) 
may overlook a number of people 
of deviant cultural groups who do* 



not show their real abilities on the 
tests that were used, and (3) almost 
certainly omit a number of people 
whose talent has been suppressed (or 
not developed) because thly grew 
up in a social environment that did 
not stimulate and guide them to de* 
vetop their talent. Hie existing 
methods of discovering* talent severity 
underestimate the amount of potential 
talent in our population, , 

Yet it is probably ?%m that, due 1 
to bur system of universal education, 
to a relatively high degree of econo* 
nomic opportunity, and to our culture 
whidl rewards or at - least tolerates 
a wide variety of talents, our societv 
probably has trie greatest amount of 
visible and developed' talent that any 
human society has had, We prob* 
ably develop more of our potential 
talent than tie Greeks of Fifth Cen- 
tury Athens, die Italians of the^ 1 
Renaissance, France of the Age of 
Reason, and Britain in her Imperial 
Nineteenth Century, ^ 
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Dr* Oxtoby has outlined for you 
the research program of the Com- 
mission on Human Resources and 
Advanced Training, His group -has 
chosen as its working' definitio^ of 
high level lalent "a person whp is 
able to work and earn a living irii the 
sciences, social sciences, humanities, 
or professions." Because work in 
these areas tends to require as a 
prerequisite an extended period of 
academic training, the definition of 
talent tends to be formulated in terms 
of ability to succeed in academic 
work. 

We cannot quarrel with the Com* 
mission if it chooses to formulate its 
task in terms of this definition of 
talent, This certainly provides ample 
scope for the activities of an able 
group of investigators. However, we 
should recognize that the definition 
is somewhat restrictive, not being 
based, for example, on specially high 
abilities in dealing with things or 
with people, as distinct from abstract 
concepts and ideas* 

Within the framework iset by its 
definition of talent, the Commission 
has been interested in determining 
( 1 ) the number and characteristics ot 
the present group of workers in the 
various scientific and professional 
fields, (2) jhe reasons why persons 



who apparently have the ability, nee* 
essary to train for and enter these 
fields do not do so, and (3) the an* 
ticipated future demand for these spe- 
cial groups of individuals* I wish Dr, 
Oxtoby had had the time this morn- 
ing to give you some part of the fas- 
cinating pictufe which he and Br* 
Wolfle have been piecing together 
from the accumulated records ot 
past testing and the fragmentary in- 
vestigations of a number of research 
workers. Some of the material, such 
as Dr. Wrenn's study of Iowa and 
Ohio State Ph.D.'s is available in 
published form, hut much of the pic- 
ture is new — at least to me — and s I 
have gotten only fragments of it in 
occasional conversations, This time 
might better be spent in haying them 
present some of the picture than in 
having me talk about it. 

Dr. Havighurst also restricts him* 
self, for the purpose of his presenta* 
tion, to intellectual ability, again fo- 
cussing his attention particularly on 
the completion of higher education, 
though he makes a passing obeisance 
to artistic and other forms of talent. 
Within the domain of academic talent, 
he draws attention to the talent which 
is latent and that which is expressed 
in actual testable ability* The reality 
of this difference has been made 
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abundantly clear by the difference in 
test performance feefween U. S. re- 
cruits in World War I and World 
War II, Tej£ performance indicate! 
that well over 80 par cent of World 
War II soldiers equalled the average 
recruit of World War I. I think that 
we would all agree that this repre- 
sented merely a more complete reali- 
zation and recognition of academic 
or test'taking potential inherent in 
our population rather than a basic 
change in the poulation itself, % is 
also a type of confirmation of ffie 

conviction , expressed by Df\ Havig-, 

hurst that latent academic talent is 
made more fully manifest in our 
country today than at any other time 
■ and place. 

Dr. Havlghurst goes on to discuss 
the factors which prevent those who 
show evidence of the ability to under- 
take college level training from ac- 
tually undertaking it, Without mini* 
mixing the importance of purely fin- 
ancial barriers, he emphasizes the im- 
portance of sub-group cultures and 
individual motivation. These points 
are perhaps worth speculating on 
from a slightly different angle. 

I seem to sense in, or project into ? 
this whole session this morning, the 
bias of a college-centered culture, 
That is, we seeni to find it necessary 
to look for reasons why people do not 
go the college rather than reasons 
why they go. Granted that the jobs 
open to college graduates tend to be 
more prestige-laden in our society, it 
is far from unequivocally clear that 
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the financial returns are consistently 
higher, or that college graduates lead 
8 a generally more contented or satis- 
fying life. That is, unless we assume 
that status, responsibility ancUwork 
under intellectual pressure are good, 
and to be desired, we may be more 
amazed at the numbers who go to 
college than the numbers who do not, 
In feeling that" more of those who 
might succeed in college (and be- 
yond) should pursue higher educa- 
tion we may be imposing a very 
biased set of valuesMipon our coun- 
trymen, .Our,, national peril may re- 
quire that we do so. But we must • 
recognize thejculture centered" ^alue 
judgment wrnch is involved when , 
we imply that it is better to be a 
harassed high school teacher than 

a relaxed radio repairman, 

*■ ' 

Or, Dailcy sets as his definition of 
talent "being in the top X per cent 
of the general population "in any 
dimension or set of dimensions of 
individual differences that is gener* 
ally accepted as being important in 
human affairs/' This is in sharp con* 
trast with the other two speakers, 
who have been rather exclusively pre- 
occupied with talent for higher edu- 
cation and a single dimension of 
general intelligence, I find in Dn 
Dailey's presentation^ in part by in> 
plication, several notions on which I 
would like to comment. These are 
(1) that there are many dimensions 
of human ability. (2) that these can 
be divided i^ito those that are im* 
portant in human affairs and those 
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^afc are not, and (3) that the so- 
cially important dimensions are only 
jftlightiy related to one ' another. If 
these nod^ni are accepted, die num- 
her whom it is appropriate to con- 
sider "talented" can be very sub- 
stantially extended, i 

The number' of dimeniions which 
can be conceived of is limited only 
by the human vocabulary, so the 
' first notion can only -be considered 
in connection with the other two, 
That a categorical clistinction can be 
made between important and unim- 
_ portant dimensions of variation is, 
I imagine, one thgt few of you would, 
explicitly endorse, In practice we 
have a hierarchy of valuations of 
talents which is quite stable and 
well-structured. Many studies in ci- 
vilian life have shown the doctor, 
college professor, and die like to 
stand high in the prestige hierarchy 
of rating groups (themsevles typically 
individuals from the intellectual sub- 
culture,) A recent study which we 
carried out among Air Force officers 
showed a similarly well-structured 
hierarchy "in the evaluation of Air 
Force enlisted specialties. The elec- 
" tronic technician is more highly 
valued than the cook, and the cook in 
^urn is more highly valued than the 
mimeograph machine operator* By 
the same token then, we have a hier- 
archy of talents which grades imper- 
ceptibly from those which are deemed 
(by some particular group) most ira- 
""■ portant in human affairs * through 
those which are judged moderately 
important down to these which are 
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judged of trivial importance. There 
is no point at which it is possible to 
make a distinction between the im- 
portant and the unimportant, nor aye 
those that are important equally so» * 

Drs. Oxtoby and Havighurst have 
chosen to deal with one dimension 
which is sort of a centroid of a very 
high priority cluster, Dr, Bailey has 
emphasiied the other dimensions * 
which grade down in importance from 
that one. My point, if I have one, 
is that many of die additions which 
Dr, Dailey will make to the pool of - 
the talented will be additions in less 
highly esteemed dimensions of talent. 
Useful ap exceptional talent in spool- 
packing may be, we cannot accept it 
as an equally-valued extension of 
our pool of talented surgeons. 



We may inquire next how inde- 
pendent the socially important talents 
will be found to be. Dr, Dailey men- 
tions intellectual aptitude and me- 
chanical aptitude as "fairly inde- 
pendent dimensions" of talent Let 
us take the Bennett type of mechan- 
ical items as representative of the 
mechanical domain and tests of word 
knowledge and arithmetic reasoning 
bl3 representative of the intellectual 
r domain, What correlation will we 
find between error-free measures of 
these attributes in the general adult 
population? During die past yeaf, 
we have pushed the doorbells of a 
good many thousands of households 
in a number of communities and 
asked an adult male in each house- 
hold, where we could find one, to 

i 
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take brief tests of the three types 
which I have just indicated. We 
were primarily interested in survey 
methodology and in the cooperation 
which it was possible to elicit by this 
approach'— which was in general 
quite good. However, we have been 
carrying out some* analysis of the 
test results, and this would lead me 
to estimate that very reliable meas- 
ures of these three abilities would . 
show correlations in the adult male 
population approximately as follows : 

Word Imowledge vs. mechanical 
comprehension, ,45 

Arithmetic reasoning vs, mechan- 
ical comprehension, .65 

Word knowledge vs. arithmetic 
reasoning,, .70. 

Taking an average of word knowl- 
edge and arithmetic reasoning as 
representing one domain, and me- 
chanical comprehension as repre- 
senting the other, how much should 
we expect to augment the supply of 
talented by considering both dimen- 
sions instead of only one? Taking 
the two degrees of talent which Dr* 
Havighurst has referred to, the top 
2 per cent and the top 20 per cent, 
I have gone to Mr. Pearson's excel- 
lent tables of bivariate normal dis- 
tribution to get/ an estimate, I find 
that I would add an additional 1.5 
per cent and 10 per cent at the two 
levels which I have mentioned. That 
is, I would then have totals of 3.5 
and 30 per cent rather than 2 and 
20 per cent respectively. 

These increments are not to be 

[ 



sneered* at, and the importance of 
considering additional dimensions in 
our thinking about talent is very real* 
However, the additional gains from 
stiU more dimensions, if they are 
correlated with several of those 
which we already have, will become 
progressively less. We" must not per- 
mit analyses based on two or three 
dimensions or ones which are un- 
correlated to cause us to get too 
starry-eyed about the "classification" 
point of view* - 13 

The typical situation in getting on 
in any job is that a combination of 
talents is "required, Dn/ Dailey has 
emphasized the gains to be achieved 
in effective supply of personnel by 
reducing the numbers of talents in- 
volved in a given job. This may be 
illustrated again by the simple ex- 
ample of the mechanical and the 
verbal tests. What is' the situation if 
the task requires,, as it may, that "the 
person be in the top 2 per cent of 
the population on both the verbal 
and mechanical tests? Our available 
supply is then 3 men in a thousand, 
^Tf we can reduce the verbal re- 
quirement to being in the top 20 per 
cent, we have available another 9 
men per thousand, and if we require 
only that he be average, we qualify 
-, still another 6 per thousand, 
r Multiple requirements * are the 
really crippling problems in our sup* 
ply of talents, and any steps which 
we can take to reduce them represent 
most worthwhile gains, 
i In conclusion ihen,** while I feel 
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"that we must expand our concept of will consider talented, the facts of 

the talented to include important at- correlation of abilities and multiple 

tributes other than thesis of abstract requirements by life tasks are such 

intellect, such as abilities in dealing that, I doubt that we shall ever be 

With things «nd people, and that in able thereby to achieve the millenium 

so doing we will expand very eon- or the late Huey Long's objective of 

fliderably the total pool whom we "every man a king," 
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Robert D, North, Henry S, Dyer, Henry W, Bragdon, Harold Gulliksen, 
William J. E. Crissey, John T. Daily, Warren G. Findley, Robert L. 
Thorotiki, Charles L, Langmuir, Toby Oxtoby, Joseph Zubin, Robert 
J. HAVfGHURSTp Guy E. Buckingham, Percival M. Symonds. 



Dr. NpRTH : I was particularly in* 
_ terested _in _ the . remarks _concerning 
the relation of the pool to availabil- 
ity and supply. In Kentucky we 
probably have a notoriously low per- 
centage of capable students going to 
college and alio a very high rate of 
drop-outs. As a resul^ of that con- 
dition, the Kentucky Association of 
Colleges and Secondary Schools made 
a survey of die reasons why students 
drop out from high school. The one 
thing that stands out in my mind is 
that the drop-outs in schools were 
not particularly marked by being in 
need of financial assistance or by 
low scholastic talent* More than Si 
per cent of them did not consu 
with the high school administrative 
officers or teachers before they left, 
which, in our minds, points to the 
one crying need for better counsel 
ing and guidance service to these 
stfldents who drop out. 

Chairman Dyer- Are there other 
commente? 

Mit Bragdon i I am connected with 
a study of the = transition from school 
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to college, which is being carried on 
by three schools and three colleges 
under a grant from the Ford Founda- 
tion. We are particularly interested 
in what happens to die able student. 
One thing that worries us about giv* 
ing the talented special treatment or a 
special curriculum is that it may in- 
crease their sense of being different 
from other people. I wonder whether 
Dr. Havighurst is willing to general- 
ize from his account of the able boy 
who wanted to be a grocery . store 
clerk: does he mean that boys and 
girls from the lower income groups 
don't want to be considered differ* 
ent; and that they fear that higher 
education will make them exiles? 
- Dr. Gulliksen." I would like to 
broaden one of Dr. Havighurst's 
comments. He emphasized the fact 
that in different social groups you 
may have different standards that will 
suppress the development of ability. 
It seems to me that similar effects 
may also occur on a national scale. 
As a concrete illustration there has 
been a lot of discussion in quantita- 
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tively-minded circles (in the Aineri- 
can Statistical' Association, for exam- 
ple) about die development of good 
statisticians, the need for more peo- 
ple trained 'in 'mathematics, and sta- 
tistics* Helen Walker, in her presi* 
dential address a while ago, pointed 
out the difference in our attitude to- 
ward mathematics and reading— not 
by social castes but over the country 
ai a whole. 

You hear personf who are respon- 
sible for educational programs seri- 
ously urge that there are Individuals 
who simply do not take to mathe- 
matics and, therefore, should be 
taught very little mathematics* It 
is asserted that such individuals are 
just not mamemaricaUy*minded and 
hence must not be asked to master 
a subject which is difficult for them. 
In our society persons are likely to 
say with some pride, "Oh, you have 
put that in figures and graphs so* I 
can ¥ t understand it I always pay at- 
tention to the eomraonsense of any 
situation.* 9 » 

If you look at the other side of the 
problem, what do you find? Do 
responsible educators say we should 
separate our population into those 
who are potentially literate and those 
who just cannot read? Students must 
study English each year all the, way 
frdm first grade through college* 
There is a growing trend to provide 
special classes for those who cannot 
read^adequately from grammar school 
right through college. You never 
hear anybody say with some pride, 
"Oh, you put that in wofds, and jdJ 



course I can't be expected to under* 
stand it." 

I wink that difference in our total 
social attitude toward verbal and 
quantitative competence is* reflected 
both by stuojfpts and by educators. 
Such a social attitude might well be 
responsible for some undeveloped 
quantitative talent in our society* 

Dr. CRiiSYi The analogy drawn 
between the specialization of platoon 
football and job specialization is an 
interesting one* When specialization 
has occurred, you intimate we\ get 
better performance in the more nar^ 
rowly defined job. We are apt to get 
more scandals! I think the parallel 
in industry or in government service 
is if you simplify jobs enough 'you 
will get discontented "experts" be- 
cause the job does not have die in- 
' terest and variety to be challenging, 
Incumbents turn to things like having 
strikes or joining front organizations 
or anything eke that will give them 
the interest^which the job does not 
give* I am not saying that platoon 
football automatically is going to givt 
more and more scandal, or that job 
simplification leads inevitably to dis- 
content; I am simply making a case 
for job enlargement* I would rather 
have an all-round football player than 
a specialist who is discontented; simi- 
larly, in the .Navy I would rather have 
an all-round sailor than a discontent- 
ed specialist* 

Dr* Bailey- Apparently* there is 
more scandal these days in basketball 
than in football* The point is, if you 
are concerned with getting the high- 
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est level of expression of the talent, 
^ that is, in beating some other foot- , 
ball team, I think it would be dis- 
astrous to try to operate with any 
system other than the two platoon 
' system with that type of material* 
Dr. Findley: I wanted to comment 
on one factor that tends to reduce 
the advantages of specialization. He 
greater the degree of specialization 
that one allows in individuals, the 
more coordination of tHeir activity 
by others is required, If we are to 
get only a small increment in num- 
bers, as Dr, Thorndike indicated by 
increased specialization, is that go^ 
ing to make up for the number of 
« coordinators that we shah* need with 
the skill hrs^o ordination that has to 
do with personal relations, and so 
forth? I have understood, and I 
think that we all understand, that 
administrators are rather highly re- 
garded and highly paid because they 
have this ability* I wonder whether 
^we are not multiplying another prob^ 
lem, when we reduce the general man- 
power problem by specialization, in 
that we have to have more coordina- 
tors with more skills of their type in 
order to make die whole system work* 
Dr. Dailey : I would think that if, 
by increasing specialization we de- 
crease the drain on, our .manpower 
pool for meeting these various de- 
mands—which may be for college 
trained people or otherwise— we ac- 
tually make it possible to select at 
a higher level on each- of. the multiple 
dimensions of these generalized ad- 
ministrative personnel Actually* the 
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same thing that gives you the greater 
efficiency may also enable you io 
get higher level people in the broad 
talent jobs where they have to be 
leaders, very good ^verbalizers, have 
high mechanical facility and also have 
a great deal of physical vigor. We 
can select at' a higher level on those ■ 
multiple' dimensions because there 
"has been less of a squeeze on the 
manpower. 

Dr. Dailey: I would like to point 
out one other factor in relation to 
Dr* Thorndike's remarks* These re* 
marks concentrate attention on in- 
tellectual aptitude and mechanical 
aptitude which are more closely re* 
lated than the others. But in the 
other types of physical conditions- 
perceptual motor aptitude, motivation 
and interest factors, and temperament 
factors^you get more independence, 
so the total gain would be more than 
you would get by considering in- 
tellectual and mechanical factors, 

Dr* Thorndike- I should hate to 
have on an important' job somebody 
who was very high on motivation and 
very talented stf far as motivation was 
concerned bufftfyho did not amount 
to much on any of these other di- 
mensions. It seems ( to me that the 
other dimensions which you have 
'there tend to be, in most instances, 
additional requirements rather than 
talents which, can stand qn their own 
feet, That is not entirely so, but I 
think it is, at least, in part the case, 

Mr. Langmuir; I lave two ques- 
tions for Mr, Dailey and Mr, Oxtoby* 
For Mr* Dailey* Is there any qiianti- ■ 
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tative estimate of gain in out 
utilization that can be expected % 
work simplification? For Mr. Ox* 
toby: Is there any quantitative eiti- 
mate of the utilizable Iftd visible tal- 
ent which is not being used because 
it ia inHhe wrong place? 

Dr. Dailey: Well, of course, in a 
4 military sense I suppose there is no 
quantitative eitimate. We are just 
now preparing to do some research 
on job simplification. My own esti- 
, mate is that it would be .very cbti- 
^Iftferable.The gain is an indirect^ 
in that what you will do is* to avoid 



amount t of waste but not any that 
say exactly how much there is. 

Dr* ZtJBiNi My comment is directed 
to all three of the speakers* I am 
not directly concerned with the prob- 
lem of selection of talent but with- 
the problem of finding out why cer- 
tain - people of* talent break down 
and do not do as well as they might. 
One concept we" Have found useful 
\ in studies of this problem is' the con- 
cept of general structure of ability 
and personality. We have been very 
i much disturbed by the fact that^e 
general procedures of correlational 



•having the man of some abiUty on " techniques do not ^eem to apply 
a jofi where he is not being ptoperly -» ^sideA these broken 

utilized rather than trying to get 
these isolated types of aptitudes that 
can stand by themselves. The pri 



niapy concern in job simplification 
would be to avoid having on a job 
personnel with- a high degree of tal- 
ent in dimensions that are^nSt very 
closely related to the job,- .; •'" 
4 Dr. Oxtoby: There is quantitative 
evidence that there is a lot of waste. 
We do not have any exact figures yet 
as to just ho% much there is. There 
certainly has been evidence that for 
any particular variable— intelligence, 
motivation, interest, and so on — 
there are many people that are high 
v on those variables and" who could ul* 
timateV' expect to go into one of the 



when you conside^ these broken- 
down personalities. We have to de* 
pend- perhaps because we do not 
have enough cases or perhaps be- 
cause we do not understand the <t~" - 



lem too well -on' the^Gestalt Of {, 
pattern of ability aAd' disability. *We . 
find some people who on the basis of 
their verbal, intellectual, and numeri- 
cal ability— should be very gifted. 
But they do not perform on that level, 
Siittd intact, do not perform at all.- 
'On r the-' other hand,, we sometimes 
fimVpsople who are much lower in 
their general level of ability but who 
have 4 certain assets which prey^ht 
them front becoming a drag on so- 



ciety* 

fc » I wonder whether in any search 
ftiRh^leveJifieldi but who -drop out at^for.talent and development of talent 
a nunia:of lower level.. There may H in general it is not essential to con- 
be Additional variables that cause sideline, totality of the Gestalt in- 
them to drop out. I should say in volved at/some sort of pattern. Some 
aMwerin^t there is some quanti- people who are low in intelhgence 
tative' data il»t there is a certain and low# numerical ability have 

"V'<"'" [42] 
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good deal of friendliness and they can , going on to study the idioayneraeies. 
<flo a gi^Job leeause they gej, co- .^pf the people to whom these people 



operation from their, fellows* This; 
Geitalt structuring of ability and dis- 
ability seems to be an important fatt- 
ier i f ;whieh has hot" ; been stressed 
enough by the speakers. 
Dr. Havighursti Mr, Zubin-s com- 



, report, Vueh as high school teachers, 
College professors, officer^, or fore- 
i&ei?'. •• • .'■ 

Svmonds* I should like to 
follow up pr. Zubin*s remarks and 
also to raise a point with regard to 



ments could open ^up a pretty wide sqfhething that Dr. Daileyssaid 
field for discussion* It does seem to" ^ * It' seems to me that Dr, Dailey has 
me that, in the search for talent," it/ /assumed, that these various factors or 
would be wise fpr us to go down," vcprftponehts are relatively constant in 
let us say, to about a llO IQ, I am ^the' individual, and although it is 
involved at the present time in a common- iprtctiflmo make that as- 
P r ^j ect where we are trying to . iden* / sumption . with regard to intelligence, 
tify all of the able— we call them it is not /safe to make ' it id* motiva- 



gifted— youngsters in a eomimAir^r 
and identify .them beginning at the 
age of, t^^We are r deliberately go- 
, ing ;to take as a first screening an llj 
; of about HQ.and above on the theory 
that you need a : substantially better 
than average general intelligence, but 
then we shall look for other factors 
and I am sure that the factor of *a 
fairly welb balanced and stable per- 
sonality is one of!ithe| main ones. I 
think that in picking put talent that 
is worth trainings i that is worth an 
investment by sodiet¥ s one should 



tioti. Motivation *rhay up or down 
and change iti pattern 'considerably, 
For instance, is - there any guarantee 
'that.ah.inLdiyiduabw^.uld-'be as highly 
motivated wKen jobs* ire highly spe- 
cialized , as h^ would, be when jobs 
are more complex? \. .• 

Dr. Havighurst ? s ^ase of the tab 
en ted boy whd resilted his parents 9 
wish to seqd him to college* even 
though they had the means interested 
me .very much. In addition to the 
socio-economic factors, there were in* ■= 
terpersonal relationship and emd- 
look for a kind of personality which/ tional factors which undoubtedly 




ihows a fair amourjt of stability and 
feal^nge and toughnejsB-r+I don't mean 
that one should require a kind of 
0ne hundred per ■ pent extroverted 
American^ personality, (tha| is not 
What:! am talking aboiP=otberwise 
we can get *a high deMopment of 
sbme particular ^bilityW which will 
ndt be socially useful. \\ j 
Mr, Buckingham i U any work 



.prevent a number of gifted individu» 
^als from developing their talents and 
which, conversely, help some indi- 
Viduafe to develop their talent to a "', 
very high level. I think that in this 
discussion we cannot neglect this fae* 
tor of motivation and the emotional-: 
favors and interpersonal relation- "' 
% s3afpfe that make it difficult for a Hoy 
to, develop to his full capacity. 
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Dr* Dailey* I think that ties into 
ray own point of view, should 
like to point out that I am thinking 
of talents as types of dimensions and 
that ordinarily the job or profession 
"will require some talent, I should 
like to tie that in wip Dr. Havig- 
hurst's idea of talent as being the 
upper 2 per cent, An example might 
be the boy who is at the 97th per- 
centile in IQ, so he is not talented 
if you consider that alone* How> 
ever he might be in the upper 1 per 
cent on Br, Bennetts test, or per- 
haps, have such a stable' personality 
and such motivation that he is 'way 
up in the 1 per cent on that. He must 
be regarded as high level talent even 
if he is not in the upper 2 per cent 
;,<-• in IQ. I also should like to ipoint out 
thajf I said that I deferred to the 
e^pators and social scientists in the 
sense that they can probably do more 
than the personnel psychologists to 
increase the supply of talent when I 
pointed out as the fourth objective 
that of assuring each individual in 
the population of a? full and adequate 
opportunity to develop and use what- 
ever latent talent he has. 

I think that there is a considerable 



amount of evidence that these en* 4 
vironmental factors do a great deal 
even in influencing such things as 
scores on printe^ tests. When you 
get to such, things as temperament 
and motivation, they probably do 
much more, » ! .don't think that we 
are in basic disagreement on that, ^ 

•Chairman Dyer: I should like to 
announce that it has been brought to 
my /attentmn that there are two re- 
cent manpower studies in which some 
of you may be ^interested, One of 
them is, "Employment Education 
and Earnings of American Men of 
Science," BuHetin4027, United States 
Department of Labor. The other is, 
"The Production 0- Doctorates in 
the Sciences,, WM to 1948 " a pub- 
lished report cof, the project "apon* 
sored by the Manpower Branch, Hu- 
man Resources Division, Office of 
>Naval Research, and it is published 
by The American Council on Educa- 
tion — an imposing looking volume* 

These two studies can be had by 
sending your request to Ralph M, 
Hogan, Manpower-Research Branch, 
Human Resources Division,' Office 
of Naval Personnel, Navy Depart- 
ment, Washington, D. C, 
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PROBLEMS OF EVALUATION IN GENERAL EDUCATION 



Considered from die viewpoint of 
an evaluator, the general education 
movement evinces two different and 
frequently conflicting aspects* The 
first of these and the 'one as yet 
most characteristic of ventures in the 
development of general education 
programs is the organization of 
courses sampling widely the subject" 
matter of a number of related fields* 
Such titles as Social Science, Biologi- 
cal Science, Humanities attest to this 
trend and are indicative all too fre- 
quently of courses placing emphasis 
on the inculcation of the essential 
elements — usually facts— of the cul- 
tural heritage* Evaluation in such a 
context poses no particular problem, 
for the task is essentially that of test- 
ing factual knowledge. The tests 
utilized in most such courses demon^ 
strata this characteristic, The one 
difficulty faced is that of construct- 
ing a test which is generally applica- 
ble to schools concerned with general 
Education ; for the wide variety in 
^election of materials results in it 
becoming a practical' impossibility 
to write a test applicable and satis- 
factory to all* It is perhaps not un- 
fair to say that the Tests of General 



Education developed originally by 
the Graduate Record Examination 
Office and the General Culture Test 
of the Cooperative Test Service, both 
now available through the Educa- 
tional Testing Service, were develop- 
ed on the basis of this first aspect of 
genera] education and have faced die 
difficulty just mentioned* 

The second aspect of general edu- 
cation is a more complex one* It 
involves on the whole a concern both 
with the use and die usability of the 
material presented in a course, It 
involves a concern ^with use because 
the material selected— the content, if 
you please— may be selected, foy ex- 
ample, because it is conceived of as 
conducive to illustrating and develop- 
ing various intellectual skills some- 
times subsumed under the title criti- 
cal thinking or because it may modi- 
fy the attitudes, beliefs, or philosophy 
of the student. This concept of use 
also brings into consideration the 
method of instruction utilized. Many, 
teachers of general education have 
come to suspect that the development 
of critical thinking or changes, in 
attitudes result as much or more from 
the type of classroom activity as from 
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the material studied. This second that teachers have more , reason Jp 
aspect involves also a concern about distrust evaluators. , The mere pres v 
usability because the content may be ence of an evaluator involves an im- 
selected in terras of what an educated plication that teachers have left some- 
individual can and should use in thing undone, Even teachers who are 
fulfilling his vocational, social, and definitely concerned with improve* 
community responsibilities or in en- ment in teaching and evaluation are 
riching, his own personality. It is likely to be hesitant or suspicious of 
apparent that this second aspect of "the evaluator because: 
general education faces the evalua* ^ 
tor with many difficult and as yet 
unsolved problems, The immediate 
difficulty of deciding how to define 
operationally such popular phrases as 
critical thinking, understanding of the 
scientific point of view, effective 
communication, desirable attitudes, 



Objectives' have all too fre- 
quently been thrust upon the 
teachers by administrators or 
evaluators, In such cases ob- 
jectives mean little to the teach- 
er, 



philosophy of life, good citizenship,— 
personal adjustment, and the like, is 
by this time familiar ground to most 
measurement experts. The further 
problem exists that general education 
in this second aspect is not a series 
of courses, not the achievement of a 
series of independent objectives but 
rather the characteristic of an inte* .*■ 
grated personality functioning ade- 
quately or better in all aspects of 
living, The evaluator who proposes 
to solve this evaluation problem must, 
perforce, ask the Almighty to find 
him space on the Judgment Seat, 
Even if successful in attaining such 
sponsorship, the evaluator may still 
expect some skepticism in his deal- 
ings with those professors who might 
well be inclined to regard Omni- 
science as a quality obtainable only 
through acquiring a Ph.D. in their 
particular field. 

In all honesty, it must be admitted 



2. In dealing with separate ob- 
jectives evaluation seems to seg- 
ment the individual. Such 
analysis may be followed by 
synthesis but this procedure does 
not satisfy those who dislike 
and distrust analytical proce- 
dures. 

3. To some teachers—particularly 
those in humanities— certain ob- 
jectives have an esoteric, mys* 
tical quality the essence of 
which must be lost in any at- 
tempt to get it on paper. To 
such individuals the mere exist' 

» ence of a test, inventory, or any 
formal evaluative technique is 
prima facie evidence that it 
tests nothing of real significance, 

4. A common, tendency is an un- 
willingness to compromise with 
anything less than perfection. 

m It matters not that teachers' 
judgments or tests are inade- 
quate; the proposals of the 
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evaluator have flaws and, are 
not to be accepted until these 
are eliminated, 

5, Evaluation ia regarded in the 
same light as testing for the 
purpose of determining a grade. 
At this point everything worth- 
while has been accomplished 
and extensive testing is a 
waste of * f time* Evaluation is 
not seen as a basis for modifi- 
cation and improvement of 
classroom practice. 
The preceding list of instructor 
reactions could be expanded almost 
indefinitely by listing other points 
or by enlarging on those already pre- 
sented* There is no need for this, 
however, for these will document the 
contention of most evaluators that 
any evaluation activity which is to 
be truly productive must be so con» 
ducted as to be intelligible and ac- 
ceptable to ^eachers, The simplest 
way to do this appears to be that 
of making evaluation a cooperative 
activity with teachers* 

It is not to be inferred from this 
stand that evaluation is to stop with 
development of evaluation techniques 
and collection of data on student per- 
formance. In connection with such 
an objective as critical thinking, a 
great deal of fundamental research 
remains to be done* It is necessary to 
investigate such questions as 

1, Is critical thinking a teachable 
ability or is it largely the spon- 
taneous interaction of intelli- 
gence with knowledge? 



2. Assuming that critical thinking 
can be developed, is it largely 
specific to the context in which 
it is learned or is it a general*, 
h&d skill? 

3. What teaching practices are 
most conducive to the develop- 
ment of critical thinking? 

4. What is the relation between-^ 
attitudes, arid beliefs (the affect* 
ive aspects "of behavior) and 
critical thinking? 

There can be little doubt that the 
future of general education depends 
to a great extent on such research. 
Much of this research can be done 
more efficiently by research workers 
unencumbered with the necessity of 
operating in the slow moving coop* 
erative situation* However, the fact 
that many generally accepted princi* 
pies of learning are completely ig- 
nored in teaching — even by psyeholo* 
gists who teach the principles— is 
evidence that research in which 
teachers do n&t participate affects 
them but little. 

The/ state of mind conveyed by 
the preceding remarks has grown out 
of my experiences in carrying on 
evaluation activities in the Basic Col- 
lege at Michigan State College and 
has been reinforced by recent ex- 
periences in the Cooperative Study 
of Evaluation in General Education, 
Indeed, the remarks may be con- 
sidered as a rationale for both the 
existence of the Cooperative Study 
of Evaluation in General Education 
and the mode of operation utilized 

? ] 
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in the Study* This Study arose out 
of a recognition by such leaders as 
Dr, Earl MeGrath, Dr. T, R. Mc- 
Conneli, Br* Ralph Tyler, and the 
late Dr* George Zook of a need for 
investigating the nature of certain 
objectives of general education and 
the extent of student development 
with regard to them. 

In the fall of 1949, Dr. Zook, then 
president of the American Council 
on Education; invited me to survey 
the interests of a group of colleges 
and universities in participating 
cooperatively in an evaluation study * 

/ As a result *of the demonstrated in- 
terest, coupled with a willingness to 
make some contribution to such a 
project, the Committee on Measure- 
ment and Evaluation of the Ameri- 
can Council on Education invited 19 
colleges and universities* to join in 
the venture. Exploratory meetings 
and college visits were carried on 
during the period from December 
1949 through 8 June 1950, This 
period was devoted to ascertaining 
a set of common objectives and re- 
lated projects in which all the cob 

. leges would engage. It is important 
to note that the cooperative effort 
was directed toward the pooling of 
resources in dealing with the more 
significant common problems faced 
in general education programs, rath- 
er than to dealing with unique insti- 
tutional concerns. 

Active work in the project dates 
in reality from the August 1950 
workshop in which six inter college 
committees meteor two weeks in East 



Lansing, These committees, dealing 
with objectives in science, social 
studies, communications; humanities, 
critical thinking, and attitudes, de- 
voted most of the two weeks to de* 
veloping operational definitions of ob- 
jectives and to sketching the specific 
cations for the preparation of evalua- 
tion instruments. As an illustration, 
the definition of critical thinking 
reached by the Social Science Com- 
mittee involved the ability to 

1. Identify central issues in a prob- 
lem, 

2, Recognize underlying assump- 
tions in a statement. 

3, Evaluate evidence or authority, 

4. Draw warranted conclusions. 
In addition to this definition decisions 
were reached then or later as to^he 
relative weighting of each of these 
in the proposed tests ar^d as to the 
content areas which would be sam- 
pled in developing test items, The 
content or problem areas included 
(1) the culture concept, (2) economic 
affairs, (3) political affairs, (4) so- 

* Antioeh College 
Boston University 
Colgate University 

Colorado State College of Education 
Drake University 

Florida State University 4 
University of Florida 
Harvard University 
Kansas State College 
Kansas State Teachers College 
Michigan State College 
University of Minnesota 
Muskingum College 
Oklahoma A and M College 
Pennsylvania College for Women * 
Stephens College 
Syracuse University 

Western Washington College of Education 
Wright junior College 
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cial affairs and were obtained by a 
survey of the materials included in 
all the courses represented in the 
committee. Some sample items and 
questions illustrating each phase of 
critical thinking were prepared to 
guide the committee and faculty in 
the preparation of test materials. 

Certain rather significant conclu- 
sions emerged from this initial work* 
shop experience i 

v L General education courses in a 
given area—social studies, for 
example— were found to have a 
Jar larger common body of con- 
tent than had been suspected in 
advance, 

2i It is possible for teachers to 
agree upon and to put in con- 
crete and operational terms the 
meaning of such vague con- 
cepts as critical thinking. Fur' 
thermore, the definitions arrived 
at by teachers of social studies 
agreed in essentials with defini- 
tions independently developed 
by teachers of science, humani- 
ties and "by psychologists and 
philosophers, % 

3, The various objectiveiSt gen- 
eral education are go interre- 
lated that the complete analysis 
and evaluation of any one of 
them inevitably involves all the 
rest. Thus, ■ for example, atti* 
tudes and knowledge are involv- 
ed in critical thinking, Like- 
wise, good citizenship implies 
the ability to think critically, 

4, Evaluation is effective only as 

[4 
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it^ makes possible both the 
measurement ol changes in the 
student and the improvement of 
the instructional process aimed 
at producing these changes. 
Some members of the commit- 
tees came to evince as much hv 
terest in the development of * 
exercises and techniques for 
improvement of class instruction 
as in the development of evalua- 
live instruments, 

5. Fundamental research is needed 
in regard to the learning pro- 
cess. Such questions as,* How 
do the critical thought processes 
of the student develop? Can 
critical thinking be taught? 
How do attitudes impede or 
promote critical thinking? Is 
critical thinking specific to the 
courses or area in which it de* 
velops or does it carry over into 
other areas? 

Most of these conclusions or ques- 
tions were no surprise to the Study 
st|fl or to the Committee on Measure- 
ment and Evaluation, but it was ijgnis , 
ficant. that, teachers should arrive, at 
them through their own deliberations. 

During the academic year 1950*51 
efforts Were directed to the develop- 
ment of a variety of tentative instru- 
ments and to extensive tryout of 
them, At a workshop in June 1951, 
the committees with the assistance of 
competent evaluators in each area 
and with data from the tryouts, pro- 
duced a number of instruments for 
use during the year 1951-52 1 
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Committee on Attitudes, Values, 

and Personal Adjustment 
Inventory of Beliefs Form I: Design- 
ed to test attitudes toward a number 
of commonly held beliefs and through 
them to obtain evidence about under- 
lying personality structure* This in* 
ventory was built around the use of 
common misconceptions illustrated 
by; 

L Lowering tariffs to admit more 
foreign goods into * this country 
lowers our standard of living, 
2. Any man can find a job if he 
really wants to work. 
Its rationale was based to a consider* 
able extent on the F scale of Sanford, 
described in the book called The 
Authoritarian Personality, 
Problems in Human Relations Form 
I: Designed to obtains by means of 
students' responses to conflict situa- 
tions, evidence about their attitudes 
toward the sanctity of human per- 
sonality. Situations' culled from stu- 
dent writing and interviews and from 
faculty observations were used as 
the basis for statements about solu- 
tions, appropriate courses of action, 
or analysis of the basic issues, From 
these statements the student was in- 
structed to choose that which most 
appealed to him. 

Committee on Communications 
Critical Analysis Test: Designed to 
obtain by objective means evidence 
about students* reading ability and 
knowledge of writing techniques, In 
addition to this test, the committee 
lias developed a scale for judging 



communication effectiveness based 
upon a critical incident approach and 
emphasizing the common character- 
istics underlying all forms of com- 
munication. They are also developing 
a set of themes carefully rated by a 
committee for the purpose of encour- 
aging greater uniformity in theme 
reading, 

Committee on Humanities 
Humanities Attitudes Inventory: De- 
signed to elicit evidence of students' 
feelings, either for or against, a 
number of aspects of the humanities 
such as kinds of works and those who 
are employed in the humanities, This 
inventory is simple in format, re- 
quiring only a strongly agree, agree, 
disagree or strongly disagree response 
to such statements as 

1, The arts are not important to 
society. 

2, The reading of plays is boring. 
Humanities Participation Inventory: 
Designed to obtain from students an 
indication of their interest, experi- 
ence, and participation in a number 
of humanities-centered activities. This 
is also a very simple instrument which, 
requests the student to check the ap- 
propriate statements in a sequence 
illustrated by the following: 

You read poetry 

1, (1) never 

1 2) occasionally 
{ 3 ) frequently 

2, i 1) with little or no enjoyment 

1 2) with a fair amount of en- 
joyment 

13) with great pleasure 
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3* (1) for the moral, the senti- 
ment, or the rhyme 

(2) recognizing such elements 
as similes, metaphors, 
rhyme schemes, dominant 
ideas, etc, 

(3) making^ careful examina- 
tion of, the formal elements, 
$tructure f ideas and their 
interrelationships. 

The first group involves pimply con- 
tact with the activity (frequency), 
the second group ' irtfblv^p the en- 
joyment derived and the third the 
seriousness or thoughtfulness of the 
approach to the activity, * 
A Guide for Critical Judgment in 
the K Humanities: ! Three separate 
forms, each designed to obtain evi- 
dence as to students v ability to make 
an analysis of a work in the humani- 
ties. Forms for Fainting,vMu§ic, and 
Literature have/been developed. This 
test involves a structure which calls 
the attention of the student to cer- 
tain characteristics of a ' work of art 
such as i * 
L Their sub j ec|i ve reae ti on to the 
work, y *V4. " 

2. The funetioriJdjAchntext of the 
work, p 

3. The nature^ use^nd ? Importance 
of the* rnedium Jflie work. 

4. pdrtnal* "elements^ of the work, 
B,\ "ihet organization jind -style of 

s mi y ^Ae work, 

AQfjlsc ""(o each 
essay 'response 
ents. * 
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Committee on Critical Thinking 
A Test of Critical Thinking Forms A 
and B: Designed to be comparable 
forms of a .test to measure critical 
thinking ability without reference to 
any particular body of subject mat- 
ter. The tests involve a series of 
problems accompanied by statements 
requiring various aspects of critical 
thinking, .» 

Committee on Science 
A Test of Science Reasoning and 
Understanding Forms A & B: De- 
signed to measure students 5 ability to 
read and i n t e rp r e t ~sc i en t i fi c materials 
written in popular style, these tests 
utilize carefully selected material and 
seek to find out the extent to which 
students can analyze, explain, or 
criticize statements, hypotheses, or 
conclusions presented, 

Committee on Social Science 
A Test of Critical Thinking in the 
Social Sciences: Designed to measure 
students' ability to tKink critically in 
the area of the social sciences without 
requiring a high level of specific 
knowledge of social science content. 
A Vocabulary Test for use with A 
Test of Critical Thinking in the Social 
Sciences: Designed to aid in finding 
out the part knowledge of content 
plays in the critical thinking process. 
This test involves social science vo» 
cabulary actually used in the critical 
thinking test in social science with the 
hope that poor performance in critical 
thinking which is largely due to in- 
adequate vocabulary can be distim 
guished from sheer inability to think, 



48 



1951 INVITATIONAL CONFERENCE 



Each committee s with the assistance 
of a Research Committee composed 
of research directors an% evaluators, 
developed a series of studies designed 
to throw further light on the validity 
and reliability of die instruments as 
well as to give some data on student 
development and to throw some light 
on a number of fundamental ques- 
tions or hypotheses such as those rais- 
ed earlier* (See point No. 5). AH 
of the tests and testing programs are* 
being given extensively in the coop- 
erating colleges this fall We shall 
remark on the purposes and use of 
the result! shortly* 

Assuming that continued financial 
support is forthcoming, it Is proposed 
that the Evaluation Study continue 
until January 1, 1954* The work of 
, the study would embrace the follow- 
ing activities j 

1* The accumulation of data on the 
validity, the reliability* and the 
usefulness of the various in- 
struments and probable revision 
of some of them as a result of 
this information* 
2* The accumulation of data on 
the initial and final status of 
students at the beginning of 
their college career and at the 
end of periods of one year and 
two years respectively* 
3. The tentative investigation of a 
number of hypotheses about? the 
nature of the general education 
objectives measured by the in- 
struments, including such items 
as their inter-relationship and 



die relative effect of various 
educational experiences in pro- 
moting student development 
with regard to die objectives, 
k* The preparation for publication 
of a final report of accomplish- 
ment, of research findings, and 
of suggestions for further ac- 
tivity based on die experience 
of the Study* 

It is fully recognized that such in- 
vestigations as the collection of data 
on student progress and other re* 
search are dependent on the validity 
and the reliability of the instruments t 
used. It i$ also true, however, that 
the findings of such investigations 
are relevant to the determination of 
validity, T^he urgency of the situa- 
tion suggests that the simultaneous 
attack on all of these fronts will yield 
valuable information which, even 
though somewhat tentative in nature, 
will bring the project to a close at 
a point where the individual institu- 
tions may carry on further research* 
Furthermore, another and more spe- 
cifically research project may be 
built on the conclusions reached in 
this one. 

The need for good evaluation in- 
struments in general education is ob- 
vious and the need for developmental 
studies rather than status studies is 
equally obvious. It is these that are 
embraced in activities 1 and 2 above, , 
However, the research implied in the 
third activity is* if anything, even 
more fundamental and deserves fur- 
ther clarification. Six significant pro- 
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jects are envisioned In this research 
area, They arei 

1, A study of growth and achieve- 
merit in social sciences, as meas- 
ured by the teat of critical think- 
ing in Social Science, in relation 
to performance on the Test of 
Critical Thinking and on the 
Teats of Beliefs and Attitudes, 

2, A study of die relationships be- 
tween certain kinds of attitudes 
and certain traits or abilities 
involved in the field of the Hu- 
manities* 

3, A study of the relationships 
among die three Humanities in* 
strumdnts and the Testa of Criti- 
cal Thinking* 

4, A study of scores on the Read- 
ing and Writing Test related to 
acores on the testa of Critical 
Thinking and the Attitudes 
Teste. 

5, A study of growth in scientific 
reasoning and of factors related 
to such growth. 

6* A study of the nature of and 
the factors related to growth in 
the ability to do critical think- 
ing, 

A brief discussion of the first of 
these will make clearer the intent of 
that particular prefect and likewise 
will clarify the type of research in- 
volved in all six. The Critical Think- 
ing Teat in Social Science involves 
critical thinking in the context of col- 
lege level social science materials* The 
Critical Thinking Test involvea the 
use of only such facts and principles 



as are believed to be in the possession 
of most entering freshmen. The In- 
ventory of Beliefs attempts to assess 
the underlying biases and the result- 
ing rigidity of individuals possessing 
them, The Problems in Human Re- 
lations Inventory is designed to deter- 
mine whether students accept demo- 
cratic or undemocratic procedures 
and solutions in situations and prob- 
lems chosen ao as to be as realistic 
as possible* In addition to these 
tests, data on intelligence and, in 
many cases, on the extent of the stu- 
dent's social science vocabulary will 
be available. By careful selectionjjpf 
groups tested and by the proper Re- 
lating of these data, the following 
questions can be in vestigated % 

L What is the relation of intelli- 
gence and of vocabulary know- 
ledge to improvement in critical 
thinking? 

2, To what extent is improvement 
in critical thinking dependent 
upon the possession or the ae* 
quiring of certain beliefs and 
attitudes? 

3, How is improvement in social 
science critical thinking related 
ti improvement in the less spe- 
cifically content-oriented critical 
thinking and to what extent is 
this conditioned by the pattern 
of courses carried by an in- 
dividual? 

4, An extensive biographical data 
sheet available on each student 
will make possible— if time and 
money permit — the study of 
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such factors as cultural and 
economic background in rela- : 
Hon to such changes as men- 
tioned in 1, % and 3, 

It is apparent that the possibilities are 
almost limitless and the task is large- 
ly that of selecting the more signifi- 
cant ones for immediate study* In 
this we have sought and continue to 
receiye advice from a number of re- 
search directors who have served as 
consultants to the project 

At the conclusion of the Study, 
& the findings to be summarized in one 
or two published volumes would in- 
cludes. 

. 1. A description of the origin the 
I mode of operation of the pro* 
ject, and the place of evaluation 
in general education, 

2. TKe rationale for the selection 
of objectives studied and the 
definitions of these objectives 
which were arrived at 

3. The rationale of the various in- 
struments developed and the 
presentation of evidence on their 
validity and reliability. 

4. Considerations of certain funda- 



mental questions about the inter- 
relationship oL objectives and 
the extent of sWBent develop- 
.rnent in regard to them. This 
y'ould involve the research as- 
pects just discussed, 
5. Indication of some of the issues 
not touched upon or of those 
needing further study, In short, 
a summary of progress made 
and a series of suggestions as 
to next steps, ■ 
ll would also be hoped mat some if 
not all of the instruments might have 
such value that the Educational Test- 
ing Service would be willing to pub- 
lish them or to incorporate them in 
its proposed Tests of Important £du* 
cational Objectives, thereby making 
them generally available, This avail- 
ability, coupled with the evidence and 
suggestions 'made in thfi-*Study re» 
ports, should efTeelivmy stimulate 
similar evaluation aj^researeh prac- 
tices in general education.' Such 
stimulus is vitally needed if general 
education is to continue its forward 
progress and give more than verbal 
support to the aims which character- 
ize it* 
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Henry S. Dyer, Douglas E. Scates, Paul L Dressel, Charles R. Lang- 
muir, Helen Jennings, Herbert S. Conrad, 1 



Chairman Dyer: We have a few Jhey felt that 4 n the teat they were 

minutes for dismission. Are there developing they ought to deal wjfh 

any questions or comments or criti- critical thinking pretty much as ah 

eisms? 4 intellectual consideration, leaving to 

Dr, Scates r To develop critical the people who were developing the 
thinking in the field of lniriiajiities les ^ °f attitude, to which I referred, 
and social studies, I wonder, whether to work into that pattern something 
any attention was given not only to which would give some impression* 
the question, *'I§ this true?" but also fl s to whether the sjudent had preju- 
to, 4t How.n\uoh cf o I want it?" and, dices^ against this sort of thing or 
^How/ilesirahle is it to me as an in* whether he had biases" that would 
dividual, tf or. the group of people interfere with critical thinking, It 
that I go %f\tii and, of course, for was ! Jiseussed extensively, but there 
society at large?" In other words* f feeling thai more tangible re- 
in the social studies and in the^Jiu- suits' would come^ul 5 of different 
inanities we are, to a large extent, instruments to get 1st this than to try 
dealing with batteries in our teach- to work them into the same instru* 
ing and I wonder whether critical menL 

thinking, as\ve seek to measure it, Mr, Langmuir: In earlier coopera- 

has been spanned to include these five studies there have usually been 

elements* news letters, interim reports, or bulle* 

Dr* Dressel: I am not absolutely tins which have been available, to 

sure that I get the pojjnt of your ques- non-participants, Is there any ar« 

Hon* but let me comment on it as I rnngement in this study whereby 

understand it, I think that the com- non-participants may keep in touch 

mittees that were concerned with cri- with the progress, obtain copies of 

tieal thinking did recognize that the test materials, see the prelimi* 

there was some question as to wheth- nary data^ and so on? 

er students were really motivated to Dr, Dressel : I am afraid that I 

develop this particular kind of skill, must answer by saying that no pai* 
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ticular arrangements have been made 
for that sort of filing-* The way in 
which we were opttating and deal- 
ing with objectives' led all of the 
committees to feel that" they wanted 
to keep this a kind of closed corpora* 
lion. They did not like the idea of 
these materials getting out Until they 
were at a stage in their * thinking 
where they thought they were reason- 
ably respectable, I think we probably 
are at that stage now- In fact* a few 
people outside of the study have some 
copieSi The gentlemen sitting next 



general, 'they do , not wish to beck- 
ing these testisthemielves, However, 
to some extent, the thing to which 
you refer has been- present. The, 
way in which we function has called: 
for a number of intercollege' com^ 
mittees with one person from the in- 
stitution sitting on \he/' committee 
and? in most institutions,/ a larger 
' number of people at home cooperate 
mg through the agency of this par- 
ticular individual. Most of the tests 
> which have been developed were, in 
their tryout stages, taken by almost 



^ u F RSi J * o ■> - ■ 4 • 

to you, Mr, Remmers, obtained some, all of the home staff in these various 



copies of it this fall and a few other 
people have written in. Where they 
are people that we know have a back= 
gcound in the field, and where we 
pan give them a little understanding 
the way in which we are working. 



institutions, and their reactions^ ajid 
experiences in taking them were util- 
ized in connection with^ revision but 
not in terms of studying the faculty 
members themselves. We had a 
proposition made by pean Morris of 



we-are filling to dq so, There is no 4 Minnesota 'last Juiie^he made it 



general »pTpgiam ;iet up for passing 
around Vsuch; information outside of 
the study as yet* 

Miss Helen Jennings: I wonder 
whether there has been included in 
the study any similar testing of the 
people doing the teaching of the stu- 
dents tested, that would give a, back- 
ground of* at least the group mem- 
bership so one could situationally 
infer what their values are, if they 
belong to teachers unions and things 



twice, in iabt f at two of our general 
meetings— that everybody in ithe six 
intercollege committees be required 
to take all of the tests developed, but 
this was voted down both times by a 
good solid majority* ^ ^ 

Mr, Conrad: I was a Iktle disturb- 
ed at what seems to be % somewhat 
dogmatic assumption, in both the 
morning session . and this session, 
with fegard to the need or advantage 
otfk wll integrated or well balanced 



of that sort, and similarly, for the « persbkifity. It seems to me that what 
parents of the tested students, Has is wanted is training that would lead 
father or mother worked for any * to some useful accomplishment, 
cause, and if so, what cause? U Psee it, Henry Ford inventing a 
DR, Dresseli This is a cooperative cheap automobile did not require 
enterprise so people do, to some ex- what is meant by a well balanced in* 
tent, what they wish to do and, integrated personality, Henry Ford, as 

[56] 



.53 



TESTING PROBLEMS 



the administrator of a great enter* 
prise, probably would have been a 
better ,1 mar) K socially had he had a 
better balanced , personality. In other 
wbrds, for th.e work of the adminis- 
trator;. a jWell\ integrated personality 
may be necessary for good social ac- 
compli ih men t in that work, For 
more specialized work, we, may not 
require a wpH integrated personality, 
.We may, perhaps, require a concen- 



tration of < mortvation bordering, 
sometimes, on the fanatical, Itmight 
say that sometimes the Wright broth- 
ers had that kind of concentrated at- 
tention for a limited field of activity. 
In any event, I Jo not think mat we 
ought to set up something as a goal 
unless it is clearly demonstrated that 
it is useful to the work for which it 
is assumed to , be necfessary* ; * 
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■ MAJOff GENERAL^iEWIS B. HERS HEY .« 

-- Herman Dyer; .Ladies and a field. It was in- that twiUghLUme 
"GrotlSfa, I donH think it is con- when, things are somewhat deceive, 
"oeWabla that anyonaJiere does not There was a fielA df grain on one 

know the president of Educational *sjfie rf|the road. A slight wind was 

Toting Service but, just out of chance bloWf^ and the grain was moving 

that they do not, may I introduce to 

you my old friend ana die president 

of Educational Testing Service, Mr. 
" Henry ; Chauncey. 

Mr, CHAUNClYi Some years ago, 

in the era of the Model A Ford, two 

friends ofmine took a trip through. 

Nova Scotia, in a blue Model A Ford-' 

roadster* It so happened that a rath- 
- er unusual event occurred in Nova 

Scotia— it would not have been un- 
usual in the United States, but it 

was quite unusual in (^nada* There 

wbh a bank robbery* T»e thieves 

made their getaway in a blue Model 

A Ford roadster, Ifou can well 

imagine the effect on my ^^iends , tlpf* 

They were stopped some eight or 

nine times, hauleoV into the police 



with ^e^wind* The fellow who was 
driving looked "over , and said, "My, 
isn't that ,a beautiful lake?" "His 
friend turned and said, 'That is no 
lake; that is a field of grain*" He- 
said, "Why it is a lake; ,you can 
i see the , waves*" Hii friend said, _ 
'/That is a field of grain; you are 
^craiy" The driver said, "Why it 
is a lake. I am positive it is a lake; 
you can see the light shining on the 
water," "Well," his companion said,;, 
"all right, I'll make a bet with you. 
If it ii a lak^, I'll dive into it, and if 
it is a field of grain, you dive into 
it." / 

So they stopped, got out and ex- 
amined it, /arf&Joundkjt was. a field of 
grain, TS| driver Walked out and 



nine times, hauled* into the police grain, *jp u " VCi " 
station, and made, Afr great ^Sng^ did a magnificent swan dive into the 



leld of grain. 
It just happened that, at that 



,* to explain their ; presence and gam fi 
alibis as to where they had been %t , 

the time of the robbery, Eventually point, some of the Nova Scotia po 
they would be cleared and aUowed to lice who had been following ti^em 

-T©6eed. # ^came up, They stopped and came 

One evening, Just %t dusk, they '* out into the field to inquire what was 

= , , . i i___?J_ ^1=* — A^&khv MonA later mA\A 



A|8piy friend later said 

ft, # 



were driving ■long (fe the road beside going d&> 
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to me, "If the truth ever sounded for anothtt reason and that is simj 
foolish— I dove into a field because it ply that I , should like you to have an 
wasn't a lake," whereupon they went opportunity to get to know General 

Hershey! I know that every jSncT of 



on 10 jaii again! 

The truth does not always— or even you? is thoroughly* familiar with him 
often^-sound foolish, but it does fre* as i public " person whose name ap«^ v 
quently sound surprising, I think pears in the press constantly, whdfe v 

if it had been said a year' ago that j sayings are quoted in^the press, and - 
the man who would make the great- who appears in newsreels, television. 



est contribution to the advancement 
of testing in 1951 would be General 
Herihey, the ^Director of Selective 
Service, that would definitely have 
been surprising. Yet today, I am sure 
. that all o? you would agree with me 

^that s due to ffje draft^defermenipro- handles a very difficult and- extreme- 
gram which included a test /a% one 1^ important job, one that by its 

%pi the bales, for deferment, it was an 



and radio programs, I think it is 
much more important tor&xiow him 
as a man, and I think you will be 
able to do so today* * : , . \ 

General Hershey is, to my mind, 
a most unusual public servant, \i? He 



important contribution to the ad- 
vancement of testing, For two tea- 

•sonar one, because it is Ae first oc- 
casion when tests have been used as 
an instrument f of ah important na- 
tional manpower policy and secondly, 
because if aroused a great deal at in- 
terest in testing on the part of many, 
many people who had not had a great 

^deal of interest in testing before that 
time. Millions of new people were go- 
ing to take the test, and other millions 
of people were, concerned about the 
general pr em of the use. of the 
tests/* It aroused a great deal* of in- 
terest and discussion, 

I think it is most fitting that today 
we shall have a special luncheon— 
such* as we have not had before at 
these conferences— and have as our 
guest General Hershey, I am actually 
more interested in having this lunch- 

^14n and having General Hershey here * 



very nature should beg perhaps ^ the 
most unpopular with the public, It is - 
the kind of job in which you might 
expect a' person to stay a yeaf of twp, 
and then, undqr pressure, withdraw. -. 
General Hershey has ieen Director of 
Selective Service for sometning inore 
than ten* years, I believe, and during 
that .time he has gained the complete 
confidence and reject of ' everybody 
from the President of the United 
States down to the lowliest draftee* 

What manner of man is it who 
can accomplish that very unusual 
feat? In the first place, he Has amai* 
ingly good judgment compounded 
from high intellectual abilitj^— he 
Wbuld score very high on any of our 
tests— and common sense. Common 
sense is a quality which we have not 
yet adequately measured* but one 
which I think we all regard as im- 
portant and one which I am sure 
Vfi wouI|i rate extremely high* He 
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is an idealist and he ia larsighted, as well aa importantly worthwhile, 
C He ieaa ImpoTtot objectives in tie |£remember that on one such occasion 

S * distance and sets hi* course towards Ac subject of speeches came up, He 

^ ^ is a turned ta me and jaidr^u^arg- 

■ atonf* Ijefcver m the democratic probably like me; you haye just 

ieeondmie process at aU levels, fro* one ^speech. Sometimes 1 begin at 

the lowest lo the highest, and he, the beginning and go to the end, 

realties that goals cannot be accom^ Sometimes I begp at die end and 

V * joshed immediately. He has, there- go to the beginning, and sometimes 

- ^ patienc€*and|M unusual philo v I begin in the middle and go both 

.m sophic attitude^tot not the phile" ways. That confuses ftem, but they 

* sophic aftitude jhat is passive and think It is . prof orind," 

* jp^throwa up Its hands il it is hot I don*t know what Genera] Hershey 
* accepted. He has,, rather, the philo- b going to talk about today and I 

^ sophic attitude that also embodies don ? t know in what directioh he is 

* doing everything that hetan to see going to go through his s^ject, but 

^ Aaslluportant objectives are achlev= I am sure that you wijf find that it 

ed. And he is an extremely hard is profound and very interesting, It 

^jjg^ is my great pleasure to introduce 

f One day last spring when ! was to you Major General lewis* B. Her- 

-~ J * goinf^down to Washington on the shey. ( 4 '■■ 

* train, 1 1 ran into General Hershey Major General Lewis B, Her- 
just as we were getting off and he SHEY! Introducer? Chairman, Ladies 
kmdly offered to give me a lift to and Gentlemen: I have a sense oihu- 
my hotel. I noticed he was carrying mor, or I would probably believe 
a bulging briefcase,; and I noticed more^of that. I have a great deal of 
that his, chauffeur brought another satisfaction in finding this is a lunch - 
bulging •briefcase for him to take- eon, rather than a funeral, and that 

■V home that evening and go over be- I am still alive., I did not expect to 
* fore the next ^ay ? s work, hear anything like that wjifle I was 

He has in addition, I think, a real alive and, of course, obviously I did 
and genuine love of people and what not expect to hear that after I had 

- v _ Kipling would have palled "the com- quit living, 

men touch." Supporting that, he has I have v been a little nervous about 
a marvelous s^ase of humor. ^To coming up here. In the first place, I 
attend a meeting With him, even^when haven't any speech left— he told my 
serious and important matters are story, I guess the copyright was out 
/Wing discussed, is always a pleasure, on it, but, just the same, it was my 
Dispersed here and there throughout story. The next thing is jjiat I am 
the meeting* are J^j^es of humor facing individuals who are proMbly 
that make it extremely enjoyable at the present time engaged in making 
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some sort of a recording, I don't area in which you are operating is 

know that you caflvgo any place and probably the greatest frontier that 

be declassified long enough" not to we have, I am not thinking partieu* 

be prbfessidhal by attempting to test larly of the testing; I 



at all times"; especially when you get 
together at one of these meetings, 
I have been awed from afar by 
the things that people in the testing 
world have been, doing for the last 
50 or more years* I know most of 
you men have been at it about that 
long, and I realize the ladies in the 
audience have only recently ..started. 
'It is not because they are not in- 
terested in testing; it is just because 
they have not lived as long asjhese 
loose hairs thit are turning grey. 
So I have been awed by the ques- 
tion of testing. However, I thought 
it a sort of prosaic thing, and I was 



of the ignorance that we meet on mis 
frontier or the ignorance that yon 
are trying— I hope incessantly— to 'd 
penetrate, because I think the frontier 
, of our lack of knowledge, especially 
about ourselves, is the greatest fron- 
tier we have, and I am %ondering 
whether there is as much lag between 
the time of finding out what we do 
not know, and the arrival at knowing, 
as there has^ been between the first 
synthetic striking of fire and the first 
fission of the atom* I don't know 
what threshold we stand on, but I 
have had a great deal of interest, I 
probably hoped at one time , that 



not prepared today to be -caught by — someone would know what kind 1 of 



the poetry of Mr. Cbauncey, even 
though he had to make Canada the 
locale and introduce some of the 
things that we see over the television 
—bank robbing for exampl&^but, 
after all, the wheat waving (not unlike 
water) was nothing like poetry, 

I have viewed your work through 
the eyes of a very rank amateur over 
a very long period of time, I am 
probably one of those persons who 
suffer with either double or triple 
frustration. When I was "young I 
probably was not educated to be 
either a lawyer or to get into this 
testing, . or to be a soldier, and I 
have never gotten to be any of them ; 
therefore I am suffering with double 
or triple frustration, I have had, and 
do have, a very deep feeling that the 
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persons we need as officers in the 
armed forces. Perhaps I am not 
so much interested in that as I was 
ten or fifteen years ago* The problem 
has been one of a determining how to 
grade what we had, when we had 
perhaps very vague ideas of what 
we wanted. Sometimes I saw that the 
more we codified what we knew, the 
less we understood and, therefore, 
the more we put down on our effi- 
ciency reports perhaps the farther 
from actuality we got, 

I am not criticizing anyone. It is 
merely the fumbling that goes on in 
trying— either with words or even 
with pictures— to portray what goes 
on inside of the human being or 
somebody that looks like one. There- 
fore, I have had a very deep respect 
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when I have looked at you from n itself we have the problem of the 

distance. I cannot lay dial I have •killed man; we have the problem of 

not more or lew retained my respect the engineer; we have the problem 

a* some- of y o u have mm a little of die scnmtiat of one kind or another, 



an some in yuu uom wnv " «»»™ — — — — 

closer, but that is not the purpose of but there is only one manpower prob- 

. — m ' . m- m I 1 !t .1 «. * _ iLjt ..lit nln BHfl t fl 



the things that I should say to- 
day. I should like to come up here 
and straighten you out on How to run 
your tuiiness. That ia not because 
I know anything about your business; 
I don't Anyway, the people who 
come down day by day to help me 

run my business— well, many times relatively simple. If we are going 
I think they know about as much to use manpower narrowly, it i§ 
about my business as I do about pretty nice to think how rare we are 
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lem and that is die whole, and to 
solve any of it gets you immediately 
involved, in all of it* 1 _ 

There is about only one thing 
wrong with manpower, we are too 
shprt in both quantity and quality; 
otherwise the manpower problem is 



yours. Also, I am 'way behind on 
giving advice to other people* I am 
'way behind on carrying out advice 
I have gotten from other people. In 
fact, it is so stacked up I don't know 
whether I ever shaU catch up* . 

Approaching any question we have 
in this country, because I am not a 
scientist — I studied liberal arts in my 
day (I don't know what they call it 
now) they didn't always call it that, 
but I mean when you spoke of it as 
you should, you called it liberal arts, 
So having come out of the realm of 
liberal arts, I am under some em- 
barrassment when I get around to 
scientists. But I like to feel, in as 
much as I don't know any too much 
about any one thing, that the trouble 
with the world perhaps is that we 
have too much compartmentalization 
of our knowledge* I am confronted in 
die manpower, field first with the* man* 
power problem, which in itself is 
merely a part of many other things. 
But within the manpower problem 



and how short in supply we are* Just 
think of a world getting to a place 
where it is in short supply of such 
as we are* 

You like figures; I don't, but I'll 
mouth a few of them. How accurate 
they are is always a question, but 
how accurate many of your figures 
are is many times a question* There 
are over 150 million people in the 
United States. As I was coming up 
here from the train it occurred to me 
there were more, but perhaps the 
streets I was on were a little heavier 
populated today* I don't want to 
confuse you too much, so If am going 
to retreat immediately into about 12 
million 4. Those are the individuals 
who are between 18 and 26 or have 
been during the last few years who 
are known colloquially as registrants* 
That is not too dangerous if you do 
not get too highly specific lA in the 
registration field. With three^ sen- 
tences I can complicate our problem 
considerably. Three million four 
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hundred thousand are over 26 and sum/ner and time changes all things 
are no longer liable; that leaves 9 and we may get, a hundred thousand 
million. Two million have already gross— of which perhaps thirty or 
gone in; I suppose we can get them forty^ftousand ean^ass^the^physica 
in again if they got out sometime but examination, if they get so far, if 
until they do we qan't do much about they cannot prove that they are farnv 
them, so that is 7 million. , Two mil- era or tool makers or some other 
lion of them are veterans under 26 reason that may defer them, I am 
years of age and are not at the mo- down to 3 million now^ 
ment liable. So with three sentences . ' Then we get into a miscellaneous 
I am down to, 5 million out of 12% group of 6 or 7 hundred thousand, 
million. That is about the way it such as a couple hundred thousand 
goes.. It is like money on payday. Of or 250 thousand all the time, whom 
this 5 million, 1 million are IB years you are going to have unclassified 
old, and while half of them become because they are just moving into 
liable, they are only partially liable the 19-year-old group,. You are going 
because you cannot take anybody on" to have a couple hundred thousand, 
under 19 unless you can establish iy and probably more by spring, who 
scientific means of testing that you are deferred because they are stu- 
have nd one liable that is available dents, or at least they have evidence 
: ^vcr 19, Therefore, while this million to indicate that they are. Then there 
has half a million of productive units are a few other groups, such as min- 
gross in it, there is some restriction isters and conscientious objectors and 
on their use. * aliens and what not. Eventually we 
I am down to 4 million now. There arrive down somewhere near 2 mil- 
are a million, in fact a million and lion, which can be divided into two 
one or two hundred thousand, who up parts, although there is lately more 
until this summer thought they had than a million in one of the groups, 
dependents, and dependents which and those are the ones that we have 
prevented them from serving in the In and of course are the fodder 
armed forces, but when Congress we are feeding just at the moment- 
passed the 1951 Act in June it took if we want to use that term—and the 
a slightly different approach, Con- other million plus are the ones we 
gress required that they have more have had up, but did not pass, Doc- 
than one „ dependent, One dependent tors turned down some of them be- 
did not count anymore*- Well, that causa they had feet off, some of them 
is correcting itself rather rapidly, were turned down by psychiatrists 
But, even so, I think we might find because they had parts of their heads 
enough to gross around a hundred massing or super activity in some of 
thousand or so— we did think two the parts that were there, and then 
hundred thousand— but that was last there is the goodly share of them that 
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are cither too stupid to paw the 
Aimed Forces Qualification test— or 
* smart enough not to. We lose them 
in either case. : ~ ■ * 

So we have around a million we 
are working on at the moment. We 
are supposed to have approximately 
two hundred thousand who have been 
accepted. That doesn't mean they 
- can be inducted ^because the doctors 
change their .minds—after all to 
change their minds is human — but 
-we lose 8 per cent in September Just 
on the differences of opinion between 
those who conducted the pre-induc- 
Hon examination and those who con- 
dueled the final examination. So we 
, ^sfrsll lose some of the two hundred 
U thousand 'already accepted, and we 
UKaJl t»e lucky if we don't lose some- 
'J what ranre^than half of the eight 
' , hundred! thousand who have not 
-* ,>hexm examined. . 
' ' " ^'TnW^f ytti ' are^ I think, or did 
mink up to" a^few* Wjseks^ ago, that 
this physical situation in manpower 
was going to begin about Christmas 
a year from now, When we started 
business in* July a year ago we had 
two jobs; had to build an armed 
force and wejhad to maintain it. We 
are pretty w4ll on towards the build- 
ing. We are just starting to maintain 
it. Itjs like marriage. As has always 
been said about a marriage, it isn't 
the cost of acquisition s it is the cost 
of upkeep. So it is with maintaining 
the armed forces. Many (mes it is 
easier to build because there is more 
enthusiasm and . all that goes with 
enthusiasm. Not only that, you can 



use two kinds of manpower; you can 
use the income and you can use the 
surplus if you 'Start with one, arid af* 
t er you ha ve^eeiHn-flie-maintenance— 
business a while you can't use the 
surplus for a fairly good reason. It 
is used. It is like the fellow who 
said to the girl, * 4 May I have the last 
dance?" She said, "You have had 
it." That is the way with our sur* 
plus; it is hot quite all gone, but it 
i§ going. You people could go at 
this in many more ways than I can 
because I have no scientific approach, 
but we had one million six hundred 
thousand in I-A July 1, 1950, 

We are down now to right around 
a million and we have not only used 
up six hundred thousand of surplus, 
but we have used up the numbers that 
would be coming in during the last 
twelve months,' Now it seems to me 
that there is no question that we are 
going to run out of surplus some- 
time. The time will depend on wheth* 
er the interim developments tend to 
give us more men or give us less. 
It is a strange thing— and I think it 
is a wonderful thing to show we are 
always optimistic— we always think 
we are going to have more money at 
the end of the, month^han we ever 
do have. The same thing with man- 
power. We always think that the 
pool of manpower is going to be 
greater at the-end of any period than 
it is. There are many reasons for it. 
Our armed forces, as we built 
them a year ago, by necessity had 
some weak points. That is because of 
individuals. A great many individu- 
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ak were called into ^rviepl^ott^^ii /. Jfi^i ^ far as the armed forces 
voluntary or tavohmtatyf^ ngt ^ter * an a Y ear 

had hardly made ^UnpV"/ M^MW^^iP^, approximately— and I am 
kfioW WfaeTe they ^A^d^^f^R^ -t[ if^ i w tf^^f what-sooner — we-are-go— 
cam© in for soraewhtt o| ^fj^^^y\^]ip^ in a place where we are 
Hey found they belong to^pi 4 ^ ^goui^t^ have.to look around to find 
ganiiaHon, Congrew to^k i^efift i^ inore; men. When we begin to look 
the fact that they ^1^^ we get into your business, 

and placed limitation <m their length , becaui^ there are some of the things 
of service* which, -fey ought to protect, and there 

of things, would '< tend? tb ^du^e^eir r are some of the things that we ought 
numbers in ' Vwmfj^^' ■y^iitk ; andv tp take note of, that involve the mat 
* after you reduce ^r^o^ some very difficult decisions, 

vidual's twenty joiny :mb^^7s^vift^ /^^y are difficult decisions because 
"teen or somethin&M is a great deal of difference of 

is discharged at ^^yp a' little ' opinion as to who should be deferred 
after, then you in,- \ to carry on the work of the world, 

stability in ih e 1 I am impressed by the representa- 

tives of different activities which be- 
lieve that their activity should be , 
supported j. by* deferment. Some of 
them even' believe their particular ac- 
tivity should be completely supported!. . 
One way to keep an individual do^ng 
something is to defer jiifnw It won't 
keep everybody stabl|$"trot ' it fl^s 
tend to encourage pepple - to stay in, 
place, because A%oifto of mem would 
just as soon bVJjjjW as some ojf thev 
plac# they ixiijj^ rjte sent ; i^ they - 
were not deferred: .There is ^p-tfuW . 
tion about (he f^ct that there are just -\\ 
literally thousands of ; ! ii(5ti yi ties , thflt , ; 
are very mueK worth? while* : , ' ^ 

It isn't letting you in pn a - secret ? 
exactly, but 1 wen^t^ college at one ' 7 
time, I majored, among other thipgs^ f • 
in education. They used to teacji uV. i 
when we were studying currt^idtini ' - 
that it was not enough "to prove j t^at^^f , ; 
a subject was of value. It could not, ;^ 



have acquir^ aWct y*Mjt* d^n^ "hold/ 
your numerical strength,' so . well J if 
numbers of t fche^nte& :$m?. jgoing 'out 
ahead of time, .^JiicK ^hey '< always do. 
And there are always men developing 
hardship and all sorfa of thirjgs; 1 You 
always lose ;rnore than you think you 
are going to lqaeJ That is gne rea- 
son why* ivfte^ I/rnaftern^ic*ally com- 
pute, I always s^bstract two 5 or three 
- f or '•four mor*th£ calculations. 1 Some 
' thing will happen to upSet the calcu- 
lations at least that much; Our re- 
jection Tate, has been: rising rather 
rapidly 4 | know it .won't go up to the 
ultimate, bui*, ^e uMimate would be 
one hundred per cent* ? . 

I realiie-we pfobabiy won't reach 
it, but when it f eta .around to fifty 
per qent I am no| fp- sure that that 
is n$t where we are, heading. I do 
not believe that I -am being overen- 
thusiasfic whert I say that manpower 
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go into the currieiUum just because terial too, but that is not too good 

It was of value. It W to be o f a defense. The trouble is, when you 

greater value than anything else add aU these arguments— logical as 

e ith er in th e curriculum or a catu M- ihey^arbe— yfa^ 

date for entrance. There is a limit to red so far as manpower goes! It is 

what can be put into a curriculum one thing to print paper money and 

and, therefore, anything you put in call it money, but what are you going 

has to be on a priority basis. Well, to do with minusjiuantities in man* 

there is a Umit to manpower, When power? Well, you people have been 

you are making calls, you leave the testing a long time, you know we 

veterans out, and there are certainly have had one factor all along, that 

many reasons why you should. If is the individual who undoubtedly is 

you leave the fathers oft— and in a minus manpower ^ quantity. But 

that ease there are at least %wo yoi have him an^ VjOu/are going 16 
reasons probably— if he is a mull 



father there may be several other 
reasons why he should stay behind, 
There is no question about the fact 
trjat the armed forces should not take 
* f.pfep^l© 4\eyf joknnot use. There is no 
h "^uestldfl^arfcUt the fact dial scientific 
and professional endeavor should be 
encouraged, because obviously we do 
not want to grow up to be a nation 
of nitwtts and have all of these other 
peoples in the world outsmarting us 
-by going to college and knowing the 
J answers, while we stumnle along and 
r^Jlo not know the answers. ' 
y.% Of course there is also no question 
that apprentices in skilled trades are 
entitled to consideration. After all 
those people actually accomplish 
^something while they are learning, I 
did not say that anyone else does 



haVe to use hinL \]lt J.thln becomes' 
n/ost necessary that when we deter- 
mine what we need now, which is the 
least of our problems, that we try to 
determine what we are going to need 
ten years front now, j That takes us 
into the training world, of course. 
There is not much use sending peo- 
ple to school for four or fi^ve years 
to solve a present shortage of man- 
power—they just do not move that 
fast—and there is not much sense of 
sending somebody now to become 
something five years from now that 
we won't need five years from now. 

Therefore, one of the, tough prob* 
lems is to try to have enough fore- 
sight to know what kind of people, 
what kind of professions, what kind 
of scientists we shall need ten years 
from'now. I think I have said, pr^b- 



not; I am merely pointing .oSjt that ably somebody told me, that atomic 



the people who are now pressuring 
me for those who are apprentices are 
saying at least tha| these people are 
partially prbductlm Of course I 
could say that they are spoiling ma- 



scientists were selling rather lnex= 
pfnsively in 1936, but even byZother, 
people's evaluations, they become 
quite expensive later on, ■ Our first 
problem is to try ' to determine where 
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we are going and what we will need 
as we get there in this training buai- 
, ness- I might say that 'one of the 
first things everybody would want : to * 
do when looking for manpower is to 
extend the age, and I can get a pretty 
good vote here 4 agreeing that that is 
not die thing to do. I: shall hot have 
'foil vote, but I am, iquite sure you 
would support mtf^ia the contention 
that the solution is not to expand the 
age. 1 have always felt it we are both- 
>-ered'-fh*the under 26 group|by a nu- 
merous two million veterans, tl^epe is 
Jho use running to a place % wheife there 
are fourteen million veterans who are 
above 26* If we are disturbed by 
seven or eight hundred 'thousand 
lathers below 26, I know where the^e 
are fifteen million above, 26.;vAs 
you extend the age upward ytm dotfjt 
seem tq ,|ind much. 

If you"a*re disturbed ab6ut the oc- 
casional highly skilled— whether he 
is professional, technical, scientific 
or just worts with his hands whom 
we find beld.w 26— there are thous- 
ands of them who at least ^laim to 
be all those things pver 26, and there 
is some proof to justify them in their 
claims. Therefore, extending the age 
does not help in solution of the prob- 
lem* . ■ i .. 

I might a d&- one more thing; if 
we lose a "million out of three million 
examined because the armed forces , 
won't accept them under 26, what do 
you think the armed forces will find 
when they ''get to work on this second- 
handed quality that you find 'as we 
go along into the thirties and'forties 
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and fifties, and so forth? Therefore, 
everything points to using the man* 
power we have except on% tiling, the 
question of training, The conflict of 
those who are dealing in apprentices 
and those who deal with students oc- 
curs in these younger peoplf/ There 
is no question about the 1 fact that 
this is a scientific age, There^is prob- 
ably some question of how much lead- 
ership we are utilizing and how much 
'leadership we are losing by having ) 
men with qualitiei «W leadership do 
very ordinary .things; which they are 
probably frustrated in doing, and it - 
would be better if someone who had 
less intelligence were engaged in those 
activities. All- of those things hap* 
pen, and wejalways get into the ques- 1 
tion of old .men who want to turn 
frothing overto the junior executives ;.; 
until they li^Ve to, on the theory that . 
if they turn it over they will never 
get it back." I«n that they are prob- ' 
ably correct, * ' - -v^ r 

Just the sameV i very serious prbb' 
letn in utilization ia poseit *One of 
the problems in engineering is to try " 
to get all the people Who. are engineers 
to do engineering. ^ ^o far as some 
are concerned, it is pVobably better 
to have them not do engineering. You 
should have tested those omV It may 
be requiring a little too "much of 
you, but be that as it rnay, if we de- 
cide we must have certain people 
set aside v for the purpose of training 
their capacities so they can give 
greater service to their country — 
otherwise there is certainly no excuse 
—you cannot tuild a system that is 
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fair tod just by standing people would requim weral years to try \ 
aside, aiftar beaiuse^ey have po- to get the public to undarstand ftat 
litical inlluence, money, or even we did a reasonably good job. That 



brains— alleged or real — you cinnot 
create in a fair and Just system privi- 
lege for any of those. The only ex* 
- quse, the only reason, the only any- 
thing for deferring people to train is 
that, by *so doing, capacities which 
seem apparent will be developed to;» 
an extent that the persons having the 
capacities can serve better and in 
positions of greater responsibility. 
Sometimes it is a little hard to keep 
thai imbedded in the minds of the 
others, but unless it is, the public is 
going to have .short timing with any 
sort of system if it becomes increas- 
ingly necessary t to t|y to put die 
finger pA the proper persons and not 
make rjiore? than SO or 60 percent 



is one of the reasons ^why We arc try- ^ 
ing to lean on the fraternity— sorori- 
ty, brotherhood, sisterhood, whatever 
we may call it— which you people 
here represent. Oh, we have the 
standing in class. When we told him 
soiikhirig, and then later asked him, 
we graded on how much he either 
remembered or made believe he did, 
We use it two ways, First, in rela- 
tionship between them, and" then we 
draw a line somewhere and say, "Be- 
low this no sheepskins*" That is one 
yardstick, Your field embraces an- 
other. / • .} ' v 
I said,. probably in jestj that I didu 
not necessarily want 'to s wallow • - 
ithet one ;of them, but I thought by <■ 



of mistake when you attempt, to 'Ahe t% of; bt>th we either would com 



train someone for higher responsi 



As 1 1 walked as a layman into this 
store, the yardsticks were (1) not 
too plentiful and (2) not too gener- 
ally accepted. Some yardsticks looked 
pretty good, but when you picked 
them up they seemed to move in any 
direction you wanted. It is a little 
difficult to measure when the yard- 
stick is one that depends entirely on 
the fellow who is handling it. Some 
of the yardsticks that seemed very 
good to me were not too generally 
accepted by the public. Therefore, as 
with the problem of education, there 
was the problem of hmng right at 
least" as often as being wrong, and 
some of the yardsticks of necessity 



pound the /errors of both, or per- 
haps have them offset each other's 
errors a little bit. It is a new field, a 
field that you know better than I do. 

With manpower as tight as it is, 
it seems to me ihat we must do the 
very best job we can in this setting 
of^men aside for training and that 
we make no errors. I think we have 
done something in the last few months 
in getting more people aware of it, 
I am quite sure there is more re- 
spect for 70, just :70, than there was 
at one time, I am surprised by the 
telephone calls I get about some very 
outstanding student The only diffi- 
culty was he only got 65 and he isn't 
even in the lower quarter of the class 
as a senior. Of course he is a good 
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man, but he is just one of those fel* 
lows who -propitbly- works a little bit 
outside ©f the normal line of people. 
I dbn y l 



W 

Ing, with %hich I have been excep- 
tionally ,well pleased. That is by off* 
ering^ something that the applicant 
i a$*ps~fo* 1 % fitf~jTWnJf~lm" wiB^|uinjr 
just about as high as he can, 

Now, cM^tUe fields that you are 
probably yfilng much in— but frank* 
ly you w^fc^^A; have to do more % 
or we shalT hlfofc to have better 



but I do know in this frontier of die 
content ol the human being, especially 
in thd relationship to other human 
beings, there * is very little explored. 
You are stilt/ploneers, and I certainly 

wish you every good wis\that I may „of w^ :you#feJwe. already done— is 
because our ability to understand fin^in^ 

ourselves is going to depend a greaf how toUest a.ni^who doesn't want 
deal on whether we hive enough to playv |f a^man doesn't 'want to 
sense to hare all these playthings we play baseball^how do you find put 
have arquhd now, in tye mechanical that he is .as good as the center fielder 



world and oot blow ourselves up be- 
fore we realize the fullest benefits 
from them;' ^ * 

I don't think, the^e; is any question 
that the greater manpower lies in . 
what we do not know about ourselves, 
and here we have been around with 
ourselves about as long as we have 
been anywhere/ I~ahi very much in- 
terested in e^eryfjiing constructive 
Hhat you do, I crfme from the field 
artillery, and the first thing they tried 
to teach me was what they could do, 
and the ntoxt thing they tried to teach 



of the Giants? That has come to my. 
attention, How do you' determine * 
what a man has when he jjo^'t put 
4t in the, window? In faetphe has it 
hidfien down in the cellar. It is not 
only a question of whether you can 
if you have him a week or have him 
an hour; one of the difficulties we 
get up against comes when they are 
streaming through the induction cen- 
ter , and someone is visited, as they 
were in World War II, by a psychia* 
irigt for 25 seconds* How do we 
find out all about those things? I 



me was what they could not do. One & doubt if we do* I think we would 



of the graveyards of hopes inters 
people who had, a machine that would 
do one thing very well and who then 
tried to cut ha^ with-it or who tried 
to put it to some other use it wasn't 
made for* You see this" fellow, the 
swimmer, whom our mutual friend 
told you about, made a mistake when 
he dove into the wheat, I now hap- 
pen to be in between the testing on 
two sides, I. have first, our own test- 



have a little more sense if 4 we would 
let the lay boys sort out the tough 
ones, instead' of trying to see all of 
jhem. It is # pretjy hard sometimes 
to sell some technicians on the fact 
that if they let go one* possible pa- 
tient they won't lose half a dozen, 
One of the difBculties we had with 
psychiatrists ^uring the war wis that 
they wanted to see everybody. They 
were not content to look at the screw- 
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balls that some of as laymen picked 
out for them and' said, Mf Look these 
oyer." Heir percentage would be a 
little tough when all they got were the 
tough ones And u there is always the 
chance that a person will look almost 
like a human being and not be bm> 
|f they are getting by, wh£ don't we 
wait? 



I looked at a report this 
morning, (not the latest) I found 
there were 288 thousand poten- 
tial soldiers, sailors, or airmen who 
are now 4^F because of a test* It 
wasn't physical and it wasn't emo- 
tional It happened to be supposedly' . 
the kind that you solve with what is 
known colloquially as intelligence, 
Somewhere around 1 288 thousand 
have failed/ 

Undoubtedly some percentage of 
them should have failed, but we cer- 
tainly must have something we ■ can 
use rather readily a lot faster than 
we tjo now. I know very well there 
are a lot o£ people of the kind men- 
tioned aAvhile ago who graduated in 
the upper naif of high school class 
yet couldn't pass the AFQT. When 
the incentive is gone it seemed to be 
a little difficult to use. the same meas- 
ure apparently established; for use 
when the incentive was there. Per- 
haps the answer is, don V dive into 
the wheat r wait for a lake, I don't 
know. But I do know that we are 



going to approach every frontier, m 
the world in trying to determine what 
the human being is an0 what his ca-* 
paeitles^ are and howrfiuch^e^agh^- 
t© bet oh'hirii. On me negative side, 
my ' experience would indicate an 
area where we have not yet learned 
the answers, or if we have, we haven't 
gotten the kind of administrative pro- 
cess to enable intelligent use of what 
is available, ' 



It has been a great pleasure, I 
have always envied those w|io dealt 
in the realm of trying to find out 
about people* and I always hope that 
I shall stay at enough distance that 
I can consider you as miraculous and 
stand in awe, rather than to get close 
enough to be too conscious of the 
fact that you, too, are human, I hope, • 
Mr, Chauncey: Thank you ever 
so much, General Hershey. I know 
that everyone here deeply appreciates 
the fact that you came all the way 
from Washington today for; this 
meeting and I know that they found 
your remarks both profound and in- 
teresting and also entertaining,; I 
can assure you too, Tthat those here 
will bo attacking the frontiers that 
you outlined and hope to be able to 
provide instruments over the years 
to come that will be of greater help to 
you and to others. Thank you very 
much, 
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TESTS FOR THE MEASUREMENT OF 
PERSONAL EFFECTIVENESS 



By way of introduction I should 
like to say a few words about the set* 
ting in. which .a^d the purposes for 
wfiieh the tests that I am about to 
describe were develdped* I feel the 
necessity, however, of pointing out 
at the very beginning that these tests 
are still far from fully developed and^ 
in most cases, to call them useful is 
more an expression of hope than a 
statement of fact. 

Two years ago, through a grant 
from the Rockefeller Foundation, an 
Institute of Personality Assessment 
and Research was ^establishes on the 
Berkeley campus of the University of 
California, The research of the In- 
stitute is directed to the discovery of 
the determinants and-characteristics 
of personal effectiveness in our so- 
ciety, with special emphaVis upon the 
effectiveness of persons in the arts, 
sciences, and professions, The sub- 
jects of our first two years' investiga- 
tions have been male University 
graduate students about to receive 
their advanced degrees either in the 
natural or social sciences, or in medi* 
cine. Most intensively studied have 
been 80 graduate students drawn 



from 14 teaching departments* In 
the spring of 1950, 40 of these stu- 
dents were assessed, 10 at a time in 
weekend assessment programs run- 
ning from Friday afternoon; to Sun-' 
day after lunch, The other 40 were 
similarly assessed over weekends of 
the following fall and winter, 

-Criteria data have consisted of rat- 
ings given each subject by at least 
three of his instructors on the follow- 
ing variables; P, the candidate's 
Potential success in his chosen field; 
O, his Originality as scholar or scien- 
tist; and S, his Soundness as;^a per- 
son. These ratings were given ^rior 
! to assessment but were not , made 
known to the Institute's staff until 
after the last assessment had been 
completed and each staff member had 
rated each subject on forty variables, 
including the criterion variables. 

In addition to several tests of in- 
tellectual functions our program of 
assessment has included a variety of 
procedures which are germane to the 
topic of this paneh ( 

Increasingly in recent years has 
the individual's perception of himself 
been urged as the key to an under- 
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standing of his behavior. To tap this example, if the adjectives are classic 
'dimension of personality/ Harrison fied as favorable, unfavorable, or 
G, Gougk has prepared an Adjective neutral, a subject's checks can be 
Check List, which, in use, has proved analyzed , %o determine the relative 
to be as ingenious as it qis, simple. ■ favGrableness or unfavorableness of$ 
Presented with a list of "234 adjectives *his self -percept* Or an index of a 
arranged alphabetically, the subjec^ subject's likeableness, as judged by 
is instructed to dneck those which he the staff, can be derived from the 
considers descriptive of himself. He ratio of the r tfumber^j>f favorable 
checks^s many or as few as he wishes, ^adjectives to the number of both fa- 
Irhe method of analysis has involv'^vorable and^||pfavorVble adjectives 
ed determination 51 of those adjectives ' eheckedVon tne £ staffis conrposile* list 
whio^ both in the first^spiing) sam- for the subject, and so on. 
pie and in the second (fall) sample It is not the findings which we have" 
have shown a significant differentia- obtained IjSrQugh the ruse "of the 
tion bej^yeen high and low subjects Adjective Check List which I wish 
in, respect of any rated or measured, to stress, but rgther its simplicity as 
variable, e. g M Potential success, a personality test and the promise 
Originality, §oundneB8, Spatial Aptj- which it holds, - ^ 
tude, L Likeableness^ etc, £S| , In the attempt to develop tests , of 

\i the end of every assessment significant non-intellectual functions 
period each, member of the staff has 
checked an Adjective List for each 
of the assessees. Thus we have for 
each" of our subjects not oujjy a pic- 
tore adjectively expressed oi that as- 
pect of his self-perception which he 
is willing to^make public but also a 
picture of his stimulus value, Apply^ ,: 
ing the same sort of analysis id the 
adjectives checked by the staff we can 
discover our common perception of 
subjects who, in fact, are high or 
low on any measured or rated vari- 
able* ^ *"f 

In addition, it is possible to durive 
a large number of rational scores 
from the adjectives checked either by 
the subjects for themselves, or by 
the staff for them,, or from some com- 
bination of self and staff checks, Tor 



attention has long been given to meas- 
ures of opinions, attitudes, pentiments, 
and beliefs* \jjjfcrking in th|s tradi- 
tion we, too, beUected .a largfe pool o| 
statements^ to be answered by tl^e 
subjects as true of falie for thenf* 
selves, which <m empirical, intuitive", 
cr theoretical grounds were cgpsid- 
eriil to hold promise for the predic- 
tion of graduate achieve.rtt.ent. The 
predictive efficiency of these face- 
relevant items was determined by 
comparing the responses of the more 
highly and less fu%hly rated students* 
in our first sample and repeating this 
procedure with our second sarnple. 

An examination of thfe surviving 
items on the I PAR scale and the diff- 
erentiating responses of the more 
highly and less highly rated subjects 



74 



tar riiNU* rituBL^Ma 



fo than conveys the impression that 
the^two g'ftups differ in respect of 
at lealt the four following dimen- 
sions! 

%Ihmp0! Tmf high-ranked subjects 
seem to lead a more consistent, 
stabilized existence. The tempo it- 
Hself may be tjj5ast or slow, but it 
^*fcnds to show lesser variations, The* 
temM^|ems to be "internally de- 
terrriuiliL" The low-ranked sub- 
jeets t show more variability, They* 
are mow influenced by group de? 
marjds; they are rnore concerned 
with problems of pacing, and the 
tempo seems to be more "externally 
determined.** * 
* Self -confidence * The ( high-rankecf 
* subjects are more self-confident^ 
They seem to have a more stable 
serlse of trust? hi the world, and pre 
Ijasically mpre optimisxic, Some of 
this may be a ireaction^to their 
present success, but it appears to 
ririP%eeper than this' alone, the 
low*rdnkgd subjects arc more in* 
flueneecFby the vicisgi^leg o^ the 
day. Their itiood depends on^eur- 
rent achievements; they feel that 
luck- gjteys a large part in suc- 



ed with immediate issues; their 
"learning set 5 ' is more for a present 
examination than for some applica- 
. tion ten years hence, 
Criiicaiiiy* Both* high and low- 
ranked subjects criticize their 
graduate training^ but on different 
grounds. The Highs feel |hat de- 
partmental standards are often too 
lax, that training is not. thorough 
enough, etc, Thpy tend to be prob* 
lem-eentered. The Lows, on^ die 
other hand, complain of disagree- 
ment among faculty mwnbers, of 
pdor teaching, etc. They Jend to 
be more personality-cejitered, 
Promising as this scale appears, let 
me add the caution that in its present 
iftage it c^n be considered gs little 
more^ than a set of guides and sug- 
gestions for further, more systematic 
research. l 

In planning our researches it se^m^ 
ed not unlikely that differences 'in 
personal effectiveness might be re- 
lated! to differences in esthetic judg- 
ment and preference, ^Specificaily we 
wondered whether the esthetic prefer- 
ences of our Highs were different 
from those of our Lows, and whether 
Cess, and that igppod Effort alone such differences bore* any systematic 
3eserv|gs to b^rewarded, They are relationship to expert artistic judg* 



less seeuij^ and seek assurance in 
fate^endeavor, e^c. They arte more 
eafeily swayed H|jfOtherV opinions. 



merit. What was needed was a test 
consisting of stimulus material about 5 * 
which esthetic judgments could be 



.tfime-j&Pjpective. The high-ranked made, and on which ' experts in art 



subjects^end to project their^Bals' 
iillb the future; 4hey look ahead* 



would |t differ .from non-experts in 
their preferences. The Welsji Figure 



they are concerned with thl-tutur.e ^Preference Test (1) seemed suitable 
use of present training, "fhe low- for this purpose, and Frank Barron, 



ranked subjects are more concern- using sc^ie 



J 05 



t Welsh's original 
t 
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ardization data plus two new samples 
of artists, developed an Art Scale* 
The 400 figures of the test (ruled and 
freehand figures drawn on 3" x 5" 
cards) were given to 37 artists and 
art students with instructions to sort 
them into two groups, those "Liked" 
and those ."Disliked." Their judg- 
ments of each figure were then com- 
'pared with the judgments of 150 non- 
artists (75 women and 75 men) diff- 
ering widely in age, education, occu- 
pation, and geographical location, 

In this manner the 65-item Bar- 
ron-Welsh Art Scale (2) was derived, 
consisting of 40 items ^disliked by\ 
artists significantly more often than 
by people in general (p less than 
.01), and 25 items liked j significantly 
more often by artists (p less than 
*^5), It is worthy of note that the 
figures disliked 1 significantly more 
often by artists were generally simple, 
symmetrical, and rather obviously 
balanced, while the ^figures liked 
significantly more often by artists 
were highly complex, asymmetrical, 
and rather restless and moving in . 
their general effect The items were 
made to constitute a scale, a high 
score on which indicates artistic pref- 
erences, 1 

When the 65 item's ofnhe Art Scale, 
abstracted now from the total Figure 
Preference Test, was administered to 
*the assessees rn our first sample, 
scores on it were found to be bi- 
modally distributed; so much so, in 
fact, that it was clear that two distinct 
groups were thus defined, When the 
four middle-most cases of the dis- 



tribution were thrown out, there was 
an interval of 20 points on the 65- 
unit scale which was not occupied 
by any case, 18 of the cases falling on 
each side of this interval 

That the figure preferences are not 
unrelated to other aspects of person- 
ality is revealed by an analysis of 
the adjectives checked by the subjects 
in these two groups as descriptive of 
themselves. These are the adjectives, 
differentiating at the ,05 level of confix 
deuce, those who prefer simple, sym- 
metrical figures from those who pre- 
fer complex and asymmetrical draw- 
ings, 

| Simple, Symmetrical 

contented 
. l * gentle 

conservative 



i "When applied back to tne original 
standardization groups, this 65-item seal^ 
separated the artists from the non-artists" 
quite effectively. The mean score of the 
non-artists was 16,9, that of the artists 
40.25. The critical ratio was 8,46, p less 
lhan .0001. Four of the 37 artists scored 
below the mean of the non-artists, while 
four of the 150 non artists scored above 
the mean of the artists. 

/'The scale was then tested on two new 
groups; 30 artists and apjgon- artists, and 
again discriminated the fjfcps effectively. 
The means of the eroiS-^afidation sample 
were 10.37 for the non-artists, and 39.07 
for the artists. These values do not differ 
significantly from the comparable values 
intne original standardization groups. They 
do, however, differ significantly from one 
another (C.R. of 3.97, p less than ,001), 
Four of the 30 artists scored below the 
mean of the 30 non-artists, while five of 
the,, non-artiflts b^ored above the mean of 
tire artists. Eight - artists and 22 non- 
artists scored below the mean of the total 
distribution, In a new sample of 80 non- 
^artists, the reliability' of the scale, as SV 
ternuned by correlating the odd-n limbered 
items with the evennumbered, proved to 
be .96." (2) 
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unaffected 
patient 
peaceable 

Complex, Asymmetrical 
gloomy . 
loud 
unit&ble 

bitter , 
cool 

dissatisfied 

pessimistic ^ 

emotional 
^ irritable 

pleasure-seeking 
A further difference between thoie 
who prefer the simple^symmetrical 
and those who favor the complex- 
asymmetrical was revealed in a Pref- 
erences for Paintings test which was 
also developed and administered by 
Frank Barron, (3) * 

In this test the subject is presented 
with 105 postcard size reproductions 
in color of paintings by a large num- 
ber of European artists, The paint- 
ings differ widely in respect of time 
and place of origin, style, and sub- 
ject matter, The subject is shown the 
pictures one at a time and is asked 
to indicate the-degree of his liking 
for each by placing it in one of four 
categories, ranging from "Like Very 
Much" to "'Like Least of AIL" The 
. subject is asked to place twice as 
rn^ny pictures in each of the middle 
categories as in each of the extremes, 
thus "approximating a normal dis- 
tribution. 

An item analysis of the Prefer- 
ences for Paintings reveals that those 
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who like the siAqpIe and symmetrical 
figures^' like best of all portraits, re* 
ligious scenes, and landscapes, and 
like least of all abstractions, the radi- 
cally experimental, the "unnatural," 
and the frankly sensual in paintinp* 
It is the other way around for 
those who on the Art Scale , choose 
the complex and asymmetricaL 
^mong paintings they prefer the 
'products of various modern move- 
ments in art— Primitivism, Expres- 
sionism, Impressionismj Cubism— the 
radically experimental, the abstract, 
the primitive, and pictures Which 
portray the common-place and the 
sensual They disjike religious themes 
in paintings, portraits of lords and 
ladies, and the simple representa* 
tionaL 

Considering the striking congru- 
ences thus demonstrated to exist, be- 
tween figure preferences, preferences 
nn painting, and the self-percept as 
revealed In se^ehecked adjectives, it 
looks as though the Art Scale is some- 
thing more than a device for the" 
measurement of artistic discrimina- 
tion, It would appear to be an instru- 
ment capable of revealing the type of 
perceptual preferences which char- 
acterizes an individual, the one type 
preferring "what is stable, regular, 
balanced, predictable, clear-cut, tra- 
ditional and following some general 
abstract principle, which in human 
affairs is personified as authority," 
(3) the other type favoring in per- 
ception "what is unstable, asymmetri- 
cal, unbalanced, whimsical, rebellious 
against tradition, and at times seem- 

f 77 1 



1951 INVITATIONAL CONFERENCE 



ingly irrational, disordered and chs* 
otic," (3) 

Though the possession of one or 
the other of these types of jeMeptual 
preference would certainly have many 
consequences, it is interesting and 
reassuring to note that, in our investi* m 
gation, the two types were observed 
about equally frequently among those 
rated high and those rated low on 
potential success* There is reason 
to believe, as Barron has pointed 
out, that, "Either of these alterna* 
live perceptual decisions may be^ 
associated with a high degree of 
personal effectiveness, 'It is as though 
there is an effective ana an ineffective 
aspect of each alternative," (2) It is 
worthy of note, however, that a pref- 
erertce for complexity and asymmetry 
is related to originality, the correla^ 
tion^of Art Scale scores with depart- 
mental ratings of Originality, being 
+.30 in the spring sample* +.44 in 
the ^all sample, 

Spebial attention has been |iven 
irt our assessment program to the 
possible development of relatively 
simple and quickly administered tests 
of perceptual and cognitive abilities, 
* Previous work in this area has sug- 
gested that simple tests of this sort 
may turn out^to be surprisingly good 
measures of more complex aspects of 
personality, jft is our hope that some 
of them may prove' to be easily ob- 
tained and precise measures, of cer- 
tain aspects of what the psycho- 
analysts have called "reality Resting." 
If these simpler measures can*.' be 
shown to be systematically related to 



the more complex functions of per- 
sonality revealed by more molar 
assessment procedures a significant 
extension of quantitative method to 
personality testing will have been 
achieved* 

For this part of our program Dr* 
Richard S> Crutehfield adapted or 
developed a series of 14 perceptual, 
cognitive, and intellective tasks* per- 
formances on which have been so 
scored as to yield 52 measures. 

Briefly noted, these tasks are: 

L Insight puzzles — 9 problems 
which can be solved through 
sudden insight* 

"2. Gottschaldt figures — each of 
which requires the subject to 
perceive jar* simple geometrical 
figure wSj^n is imbedded in a 
more complex figure* 

3. Masked figure — a single draw- 
ing which is constructed of a 
word and its mirror image from 
below so joined that the word 
tends to be masked by the larg- 
er symmetrical figure, The task 
is to perceive the word, 

4. Tilted square — a procedure 
which requires the subject to 
locate the vertical axis when in 
a completely dark room, the 
only visual cue being a luminous 
tilted square, which provides a 
distorting frame of reference* 
(from Asch and Witkien), 

5. Autdkinetic movement — with 
measurements of the extent, di- 
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raction and character oi 'the 
perceived movement, 
6, Visual-motor organisation — * 
which requires' die subject to 
trace a luminous ^outline square 
which is exposed in an other- 
wise dark room* , *. 
LUte movement — in which a 
pattern of 45 degree angle lines 
drawn oh" a roll of paper mov- 
ing . downward at a constant 
ratfej is exposed Taehind a square 
aperture. The elapsed time be- 
fore the perception of vertical 
movement gives way to horizon* 
tal movement is measured, after 
which fluctuations of vertical 
and horizontal movement are 
recorded.? 

8, Weight- judgment — which 
measures the character of shift 
in "adaption .level" of a series 
of lifted weights as a function 

. of systematic changes mtrodue- 
ed ? without the, subject's know- 
ledge, into the range of weights 
being judged. * - 

9. Kinesthetic after-effect — ? a test 
which measures digtortiQns in 
kinesthetip perception .finder 
several conditions aji a conse- 
quence of previous kinesthetic 
stimulation, and the . persistence 
of such distortions. JF 

10, Tapping which 'consists sim- 
ply in determining the tempo of 
tapping .under ■ iflstructibns to 
tap at a "natural'' or "neutral" 

, "• • f ate. , - v ' .:' . 

1 1 . -Retinal rivalry — the determina- 



: i<. 



tion of the rate of alternation 
when rivaling retinal * stimuli 
are exposed in a stereoscope* 

12. Size of constancy — requiring 
* * judgments of equality of a vari* 

5 able distant triarigle witK a near* 
; by standard one* , " 

13. Multiple chowe — employing a 
modified Yerltes^ multiple-choice ; 

■ t. apparatus on which * aftei* thjee • * *j 
problems solvable by tjie sani| 
general method have been^pre. 9 ^ 
sensed a fourth problem, re- 
quiring a; hrnyi, type, of solution^ < 
is presented. 

14. Street Gestnlt Test — in' which 
the subject is presented wjt|i 25 

■ incomplete pictures of /objects 1 , * 
his task being to infe/\ in each 
case, the correct identity fr bf the 
, ■' * object . „ s »' ' * ' , I a 
It is too early to say which, if any, 
of these ; p^e" tests either individually 
of in a brief battery will prove to. 
be effective predictors pf the criteria^ 1 
of personal effectiveness, which we\ 
have been stiiq 

In our first s|m| 
the two criterion grojj 
Lows in average 
ings of P J 0 * 
p-c measures w 
fiearit/differenees 
en as 1 molt k &' 
assessee was 
battery of 16 p^c 
ing (Shis T- scores 
pected, the suram 
.f tained correlated: quilfc highly In our 4w> 
5 first%mple f+.$0 w^) s biR.the^ 
correfeplrij s h m e jj coniidera^lej^ 

ci * "... 
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shrinkage on cross-validation. But 
that these tests are measuring signifi- 
cant aspects ol personality is suggest- 
ed by an item analysis of the adjec- 
tives checked by, the staff for those 
subjects scoring high .vs.- those sub* 
jects scoring low on these tests. 

Adjectives checked significantly 
more often as descriptive of the high 
scorers on the p-c measures were* 

li adaptable 26. .responsible 

2, appreciative ^ 27. resourceful 

3, calm 28. self-confident 

4, capable 29. serious 

5, clear-thinking 30, sincere 
Al, sympathetic 

32. thoughtful 

33. tolerant 

34. unassuming 
13. organized 
19. pefsistprifA, 
•20, poised ^\ '* 

21, progifrssive 

22. cmick . ' 
15, iikerests wide 23. ... rational 

^ ,16- $ature,. : 24. realistic 

"£ U Y. ^niocle^e 25/ reliable 

* VlniTftrl^ng contrast to these are 
4 the aHjectives checked significantly 
more often for those poor on the 
. p-c tests : 

' <% 1 . affected rf^© meek 
>. 2. confused 4l. natural 
3. ■ dependent- 12= Resentful 
V4.= dissatisfied ^-13. self^cgptered 
dominant . " 14. self -punishing 
J5* submissive 

16. talkative 

17. imstable 

18. weak *W 



6* conscientious 
7, cooperative 

curious 
9, fair-minded 
10, foresighted 
if. frank 
4;2- ; friendly 
13, helpful 
14: honest*^ 1 





- \6. 


emotional 




7. 


fearful 




8. 


fussy 


• » ,■ 




^tnrtature 









In his factorial studie|4^pp^p^ 
tion and visual thinkj^^^pf^tone 
(3,4) has identifie|p^c)^^e fac^ 
tors, The Street Ge&j^ffijifb a ttest of 
the first closure factc^^^otlscKaldt 
figures a test of j^^^prid- closure 
factor. Both of tW^^ctors, T hur- 
stone reports, lee^^M^t^n^end to 
some extent the v^is^' -modality. It 
has been his im^^^on that those 
who are high onjSp first closure 
factor (Street tend to be 

outgoing and extr 
who are high &n 




rjed, while pilose 
iseconoi closure 
igurefej^tend t^ 
>re/. ijitrbvettefl 

VJk 

irniatisn 
;h£<^ed signi 



factor (Gottsch 
turn inward^Jr 
manner 

We find 1 
in the adj 

more often by us 
oil" the Street 
1 on the Cqttft 

.Closure h actor I 

Highs 
adaptable^- * 
assertive ''^iK ward 
^v^Y^"V^^^minate 





natu 
practical 
responsible 
j ^^cere 



idealistic 
sarcastic 
sentimental 

s 

shy r 
oughtful 
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Closure Factor II — 
Gottschaldt Figures 
Lows 



anxious 

awkward 

submissive 



Highs 

clear-thinking 
enterprising 
foresighted 
honest , 
organised 
rational 
thorough 

The tests that I have described for 
you* as well as many others which 
there has not ? been time to discuss f 
are ? of course, fairly crude. Our 
work with them is still rather pre* 
liminary and our findings to date 
are highly tentative. It ii, however, 
I feel confident, along such lines as 



we are exploring that ev entually use- 
ful tests for the measurement of non- 
intellectual functions will be devel- 
oped, 

REFERENCES 

1, Welsh, G. S. A projective figure-pref- 
erence test for diagnosis of psycho- 
pathology: l.A preliminary investiga- 
tion. Unpublished Ph.D, thesis* Univer* 
sity of Minnesota, 1949, 

2, Barron, F, and Welsh, Artistic per- 
ception as a possible factor in person* 
ality style : Its measurement by a figure 
preference scale, /. Psychol., (In 
press) 

3, Barron, F, Personality ityie and *per« 
cepiual choice, /. Personality (In 
press) 

4, Thuf stone* L L A factorial study of 
perception, Chicago \ The University 
of Chicago Press, 1944, 

5, Thurstone, L, L. Some primary abili- 
ties in visual thinking. The Psycho- 
metric Laboratory, The University of 
Chicago, No, 59, August, 1950, 



81 1 



The Development of Useful Tests for the 
Measurement of Non-Intellectual Functions 



RAYMOND B. CATTELL 



PERSONALITY STRUCTURE & 
PERSONALITY MEASUREMENT 



There is a species of educational 
psychologist* probably still, represent- 
ed at this meeting, to whom it* will 
seem strange that in my title I have 
given personality structure priority 
over personality measurement In- 
deed, if he goes along with the kind 
1 of personality tests most popular in 
schools, industry and guidance work, 
he will wonder why the"*organization 
of personality has to come in at all. 
iff I am correct^ there is something 
profoundly wrong in 1 the current ap- 
proach to personality testing and I 
beg your leave to spend five minutes 
analyzing what is wrong before my 
ten minutes of saying what I think , 
is right; for we have a problem of 
re-education here. 

It may be ungracious of me, since 
this meeting is under the auspices 
of educational psychologists, to sug- 
gest, as I have just done that the 
first thing wrong is the system of 
habits in the typical educational psy- 
chologist, But, in the firit place the 
educational psychologist is unduly 
obsessed with items, item analysis 
and snaling, so that he suffers from 
delusions that personality is paper, 



If any personality test I am designing \ 
falls into itemizable and atomizable ^ 
form that is generally the sheerest 
accident. Its numerical score is in- 
deed more likely to be the frequency 
at which flicker-fusion appears, or 
the magnitude of a psycho-galvanic 
reflex response, or the ratio of certain 
reaction times, or oscillation in ver^ , 
bal output and so jTn, So long as 
personality testing W conceived only 
within the cramped perspective of 
juggling with what are essentially 
fragments of scholastic examinations 
called "items" it remains an unim^ 
aginative and trivial creature, un- 
weaned from attainment and ability 
tests and psychologically impotent 

Some good personality tests will, 
of course, be in item form' I am 
only criticizing those whose whole 
horizon is bounded by the jargon 
of item methodologies. In for ex* 
ample, Guttman's discussions on tests, 
an impressive and intricate super^ 
structure of scale analysis' principles 
is built upon a recipe/ which begins 
''Take a number of items with the 
same content/' Now it may be safe > 
arbitrarily to choose content in an 
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achievement teat in Geography, 'or itemitis is therefore not the paten 
even in an attitude test on Republican- medicines of the less scientific elim- 
ism, but when we move from class- cian. Indeed, although the hocus* 
room material to personality manifes- poeus of the patent medicines may 
iations this practice becomes very mis- seem superficially to lie at the opposite 
leading, A personality trait can mani- pole from the honest, antlike industry 
fest itself through practically any of the itemkers, the differences are 
content. Consequently I don't think a of less importance than the similari- 
serious student of personality can get ties story. What they have primarily 
very interested in a complicated game in common is jl complete disregard: 
of scaling procedures wherein meticu- of the necessity for discovering a 
lous objectivity, at one point is mixed great deal about personality structure 
with the most naive subjectivity at before; beginning to put a test to- 
another. ? " ,gether. ~ This whole stage of mental 
Becoming disillusioned by this test^ practice, now fortunately/ near 
monotonous dripping of pencil and diss%t|jfc, has been a strange far- 
paper items some psychologists have rago of expediency^ superstition, mis- 
turned for: salvation to the crystal placed accuracy and unjustified ap- 
ball, as exemplified' by the Rorschach, peal to "pragmatic proof," indeed 
Zondi and similar, paraphernalia of it reminds one of the second! verse 
the mofe occult clinician. These I in Genesis where "the earth was with- 
have called "patent medicine tests" out form and void; and darkness 
. because whatever may be found out dwelt upon the waters," 
about their validity no light is thrown As to the nature of personality 
thereby on geheralizable scientific structure we have for our contingent 
processes and laws. For they do not guidance the more or less elaborate 
deal with distinct, known psychology hunches of psychoanalysis and clini- 
cal processes e.g. rigidity, fluency, cal psychology, which at least are 
relation eduction, corresponding to scientifically respectable at the level 
separate dimensions of personality of pragmatism. We have also such 
but claim to reveal the whole of per- systematization of general observa- 
sonality through a single test capsule, tions as in MeDougalFs theories of 
How hollow this claim is can be seen m sentiment structure, and so on, Brih 
from Thurstone's finding that the liant though these leads have been, 
Rorschach measures touched only one their methods are only capable of 
out of about a 'dozen factors found vaguely adumbrating the shape- of 
in perceptual responses, or from the things to come. I deny the separate 
extensive published and still more existence of the so-called clinical 
extensive unpublished literature of method as an independent scientific 
projective confusion and invalidity, approach to knowledge— though not. 
The remedy for the educationist's of course, as a method of therapy or 
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ai a preliminary reeonnoitering de- 
vice, Scientific method has two hands 
—controlled experiment and statis- 
tical ...analysis of the uncontrolled, 
The clinician uses both of these, tak- 
ing nature's accidents for his experi- 
ments and an intuitive use of the rec= 
ords of memory ih< place of statistical 
machines, (He is a one man scientific 
team, using the two basic methods of 
science with a justifiable roughness, 
Jbut he must excuse us for concluding 
that his findings need precision con- 
firmation). 

Since there is very little of the total 
personality in its life situation that 
can jhe brought under brass instru- 
ment, controlled experimentation, the 
verification and extension of the exist- 
ing hunches about personality struc- 
ture will in my opinion be brought 
about largely by statistical methods. 
Particularly our hope lies in that 
wholistic, simultaneous structuring of 
a great number of variables which we 
call factor analysis, Jn research .guid- 
ed by these principles at the Labora- 
tory of Personality Assessment and 
Group Behaviour ' ( U LPG ,? ) of the 
University of Illinois, we have Isolat- 
ed and confirmed by repeated studies 
rather more than a -dozen factors, 
labelled alphabetically 4 through 0, 
and these factors make good sense 
psychologically, as unitary structures 
interacting in the integrated person- 
ality" One of them, the C factor, ap- 
pears to correspond to what the ana- 
lysts have been calling ego stfength 
and offers an opportunity for more 
controlled and precise investigation 



of ego structure, Another, the H 
factor, is one of the two principal 
factors in the schizophrenic correla- 
tion cluster and appears to be largely 
a function of psysiological, autonomic 
capacity/ Yet another (G) corre- 
sponds to the super-ego structure, and 
so we could pass to further illustra- 
tions if there were time, Each of 
these factor^, first found in ratings 
and then in' questionnaires response 
patterns, has been used finally as an 
hypotKesis for the construction of 
special devices to measure it as a 
factor in terms of behavioral, ob- 
jective tests. For this purpose we 
have used nearly two hundred newly 
invented tests, some of the type de* 
Ascribed by the previous speaker. 
The conception of personality struc- 
ture arrived at in this way is asso» 
ciated with several methodological de- 
velopments and special conditions In 
the use of factor analysis which trans- 
cend what is commonly understood , 
by the bare and basic mathematical 
process of factor analysis, These con- 
ditions have implications for the logi- 
cal definition of a unitary trait and 
for the nature of personality predie* 
tion. Principally -they _ include: 
oblique ^factors, tKe goal of simulta- 
neous simple structure in seyeraLma* 
trices instead of Kvith respect to one 
only, the possibility of verification^ 
of factors by experimental influence, 
the notions of wholistic and condi- 
tional factors as determined by choice 
of variable modalities, and {he stra- 
tegic use of and P— techniques 
in combination, I have time for a 
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few words only on the last of these. 

The theory here is that if a trail 
is to show functional unity in the full- 
est sense of that expression it must 
appear not onl% as a factor unity in 
terms of ^individual differences i.e* 
by R — ^technique, but must also show 
a unity of development, as discerni- 
ble in an R— technique analysis of 
increments^ and a unity of function 
fluctuation as shown by the P-*— tech- 
nique analysis of the single individu^ 
ah In P— technique, as you know, 
one can take the same set of variables 
as in R — technique and apply them 
every day, for perhaps a hundred 
days,, to # ©ne individual, correlating 
the series thus obtained and, factor- 
*izing the matrix. The, evidence so 
far available, suggests that some uni- 
tary traits appear both in R— and P— 
techniques while others appear only in 
one circumstance of variation, so that 
we must speat of unitary traits hav- 
ing differing degrees of efficacy, i.e. 
ability to fetain their form. Know-" 
ledge of efficacy is of importance in 
what might heS called the natural 
history of a factorial trait, under 
which we include information about 
how it changes with, age, what its 
nature-nurture ratio is, what relation 
it, has to psysiological conditions, to 
early childhood trauma^ to vocational 
success, to therapeutic prognosis etc. 

If we deliberately take a very catho- 
lic array of variables in factorization, 
under -the giHppiGq of the "personal- . 
ity sphere" concept, we seem to arrive 
at factors of all three modalities-^ 
some,' like our B factor, are abilities; 



others like surgency-desurgency, seem 
to be classifiable as temperamental, 
physiologiQally-determined f a o t o r s 
and others^like factors C and E— 
the latterpKeliig dominance or self 
assertion^^e clearly dynamic traits. 
From the point of view of what the 
clinician means by personality struc- 
ture, factor analysis has given far 
too little attention to this las| class 
of traits. However* it can be shown 
that by starting with an exclusively 
'dynamic set of variables, such as atti* 
tudes* one can arrive at factors which 
_ appear to be Sie long anticipated pri- 
s mary drives mr ergs. Although the 
evidence is very recent I am con* 
vlneed that factor analysis has demon- 
strated its capacity to reveal ergic 
structure, so that it is now practica- 
ble to select from the loading pattern 
objective tests designed to measure 
the strength of particular ergs as 
common source traits and thus to de- 
termine the, roots of the average per- 
son's motivation in any given per- 
formance or situation, 

The clinician, who has never made 
much use of common ^source traits, 
is more likely, however to be Inter* 
ested in the unique dynamic .source 
traits yielded by *P— technique. In- 
deed, the specification equation, ob- 
tained through . factorizing ergic 
'"marker-variables" along wi^h symp- 
tom measures (made from, occasion 
to occasion) gives an analysis oj ihq 
symptom into its ergic roots^with a 
precision desired but never atlain^ 
by psychoanalysis, P-=teehnique used 
with dynamic variables, thus fulfills ,' 
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the diaghosfttf, though notof cburse, 
the therapeut^ intentions oKjpayeho- 
anaiysis. This is but o^^itii&tyjtkm 
of. my general mdint thai eUnical 
method is essentially an intuitive sta- 
tistical ihethod and that psycho- 
analysis comes of age when it becomes 
factor analysis, I have tried to show 
elsewhere that this method fives also 
a quantitative psychodynamic treat- # 
meht of mental conflict and of inte- 
gration. All this "would seem to in- 
dicate that the prediction of person- 
ality reactions is going to require 
far more attention to dynamic vari- 
ables than has yet been given, by 
mental testers, as well as an extensive 
use of P=^technique concepts and 
methods in combination with those of 
the traditional R— technique. And* 
although this has most application to 
clinical, psychology , where those idio- 
syncratic traits which we call syrnp-* 

toms are to be measured and under- 

/ ... 

stood, it applies to any personality 
prediction, The combination of mea- 
sures from the R — & P— system!; 
with the interaction of normative and 
ipsative standardizations which will 
be involved* should provide some in- 
teresting statistical problems*, ^ . 
U will be recognized thW^e-u>ol 



of factor measurements w^bfei'l "^tj-V 
advocating ventures to' rg^' b^ond 
that implicit in most factor ^itialytie: 
research aims and involves additional 
assumptions needing examination. A 
majority of factor analytic researches 
seems to assume that the factors found 
are peculiar to the particular test 
area with which the researcher is 
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preoccupied, The theory which has 
guided research in the Laboratory of 
Personality Assessment of the Univer- 
sity of Illinois is that the principal 
personality factors operate in many 
different media and that rese^chers 
"in .different fields are probacy deal- 
ing with the same factors in different' 
dress. In terms of research planning 
this means that* a careful and thor= 
ough sampling of factor "marker vari- 
ables" must be carried, into any speci- 
fic research and that the planner must 
have an alert and comprehensive view ^ 
of the whole of factor analysis and its 
findings, as well as an appreciation of 
personality theory in general. 

In terms of applied psychology it 
means d that we must abandon the iso- 
lationism of ^lidustriaU educational 
and clinical practices. For many- 
years, I have found it necessary , to' 
argue in personality nest work" for 
the personality one and indivisible^ 
by which 1 mean that the* individual 
who enters the factory, the school, 
the home and the clinic is one and the 
same person, and if we aro working 
on a true conception of personality 
structure we should bo measuring the 
same factors and u>i g the same tests 
in all of them., Only in this way 
moreover, can we take advantage of 
the accumulating knowledge about the 
natural history of these factors, con- 
verging from practice? in several fields 
upon the, basic structural picture, 

Yet the industrial psychologist has 
been content to measure factors in 
his particular questionnaires or tests 
without any understanding of what 
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those factors are i*i general psycho- practices the errors of his forefath* 

logical terms, indeed, he is working, ers." Naturally the pragmatic proof 

more frequently even to-day, with a of the effectiveness ot- dealings with 

mere correlation between some speci- personality measures related to per- 

fic f test and a criterion, not knowing sonality structure, as determined by 

how or why works or Whether it factor analytic and experimental re* 
wtll^Biiappe^^ 

other sample, for reasons beyond 8 his cal hunches, can only come' with in- 
interesf. Again if we compare the creasing knowledge about the natural 
educational psyeflologist w-and the history of those factors, that is, with 
psychoanalyst or clinical psychologist time and, organized applications of 
it is clear that they might be dealing factor measures. Then the predio 
with entirely different .persons as far * lions of the structures involved based 
as their test -batteries are concerned, on knowledge of the rise, decay, 
Fqt whereas the former attempts to learning and interaction processes in 
predict college success almost entire- structure, are /bound to reaoh gut 
lyfoy an intelligence test or at least farther and more accifrdtely than the 
. a battery ^of ability tests the latter r^le^ of- thumb procedures of insight-, 
analyses collega^or* occupational ad- less "^test accountants*" 
justment without any preliminaries Howevej^ as a writer of test hand- 
of mental, testing. c Indeed the only faool^s, I foresee a wave of protest 
numerical estimate that a psycho-* arising at *the, point when psycholo- 
analyst is known to'make is one of his "gists ^have, to admit^if only in the 
patient's bank account! * * ■• interes^d!* accurate prediction, that 
* The narrowness pf the various ap- psychonierry%has to begin to match the 
plied psychologies* and their apparent beautiful intAeacy of nature* itself, 
belief that they 4 can muddle along with " Most test users demand a right to be 
local measurement practices has f a^ supplied with a penny-in-the-slot de- 
ways seemed to me ari inc^e^ible vice which, any grade school ( teacher 
short*sightedness, tut ,1 kaveT,|o^rhd or foreman can cVrriprehend at once, 
that n^y astonishment is reciproeafed . . People who could not safely be left 
by these^ practitioners, who in turn to measure tip the office carpet ex- 
view my interest iri#general psycho- pect to be allowed to calculate a per* 
logical principles either as imgracti^ ^sonality profile for a buajriess execu= 
cal idealism or a^. harmless hobby, tive* to understand what it means and 
They like to talk of factors* as ^unreaL to make momentous decisions in peo- 
abstrijkjtions" and to assume that "rule pie's lives by ©hly the simplest arith> 
of thumD*' has a monopoly on practU metic, TFhere are test publishers 
^palif^ I, am reminded of, a motto iri- ready to" oblige them, 
scribed in R. ^Fisher's laboratory; , The present approach, as it con- 
^The* practical man is the man who 4 cems test construction, means that 




internal or intrinsic ValidAtoWi in 
terms ©r^oritlation with a factor^ 
must precede, peripheral or pultur&j 
validation, in terms of regressions on,£ 
such Aings as success in occupation^ 
^c^ftioal prognosis or^coritribution to 
educational achievement. To produce 
i test with the greatest factor validity 
which its length and reliability will 
permit has thus been the aim in the 
tests which I have constructed for 
the Institute for Personality" ■ and 
Ability Testing. That a set of* say s 
sixteen independent factor measures, 
even though each has the comparative 
unreliability of a short test, should 
give better criterion predictions than 
a highly reliable hut faetorially un- 
structured test will evident either 
from Shannon's writings on Com- 
munication Theory or from consid- 
eraypn of ^multiple correlation, ^IJn 
terms of communication theory each 
factor meafcre is an independent 
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piece of ^formation? whereas each 
score oh inter-correlated tests is par- 
tially 4uplicatecJ r irHormatiom The 
inde^enlSence d^the elements in a 
profit constructed on. distinct factors 
also permitrnhe use of the pattern 
letions r mate&- 



iirnllaTitfiptterini v ^ 
ings etc? in a way not possible with 
corrected measures, , * 

In summary, the claim for measur* 
ing .personality in^terma : ef factors*or . 
source traits thus has three main 
justifications i 

(1) A neater statistical handling of 
prediction problems in all their forms. 

(2) A drawing together oj the di* * 
verse 'fields of applied psychology**^ 
with the dowry of accumulated know- 
ledge in each. * „ w 

(3) A correspondence with the 
functionally meaningful structure of 
nature and an interaction with basic 
principles of /general psychology, but 
the most important of these is the last. 
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mSCUSSION^rPROFESSORTWSCKINNdN 



Mr. MacKinnon has given a lucid 
account \ of his activity^ in creating 
methods to discover "the determinants 
and characteristics of personal effect" 
iveness in our society," It 4§, further, 
a, very modest report, emphasizing 
the* exploratory status of the work. 
No reasonable colleague could do 
other than hope that the MacKinnon 
.group will have the motive, the 
strength and the means to continue 
and complete their project. 
The positive features of this effort 
s^eem to me to be the following: 
(1) Importance of the problem. 
Good technique and ingenuity 
are of but little use on a piffling 
problem. The study and predict 
tion of professional success are 
not "in this category. We must 
cherish our talented people, identi- 
fy them as early as possible and 
give them appropriate encourage- 
ment^ He whp has sat on the Ad- 
missions C#mmitte|| pf a Graduate 
Department will know the uncer- 
tainty ^wjiich hangs over the selee- 
. tion of graduate and research per- 
sonnel The beloved record of col- 
lege grades may only suggest the 
"unimaginative grind, nicely habitu*; 
ated to academic authority. The 



results of our present selection pro* 
cedures are, to me, always surpris- 
ing, TBb sleepers may wake up 
when challenged at the Graduate 
level. Some of* the collegiate play- 
boys settle down,- Some students 
reveal not only no aptitude for 
scientific theory tbut a genuine 
hatred of theoretical construction. 
They view it in very personal terms 
as hampering and limiting. Others 
gladly and intuitively subordinate 
themselves to ,a Woxld which they 
assume to be orderly. 

Miller and I have stated what we 
believe are two of the conditions 
for original scientific work: that 
a man have courage to resist au- 
thoritarian opinion* , \jt le being 
strongly subordinated to scientific 
method. How will one find these 
students and eliminate those who 
show the opposite trend, who are 
, insubordinate toward method and 
accept traditional views with pap? 
sionate alacrity? Further, it seems 
very likely that the training for 
good Scientists and professional 
people begins in the simplest cir- 
cumstances of life, and certainly 
long before the student is involved 
in higher educational procedures. 
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Ho^ire these char^|eroh 
variables £ Yrhieh favor or forbid the 
development of a scientist to be 
discovered? It seems to me that 
Mr. MacKinnon and his colleagues 
have addressed themselves to these, 
^meng^die&^robtoQi-oi-^quei^ 




tionable importance* It is a, good 
trait in a scientist that We has the 
sense to intervene at a favorable 
point in the course of events* 
(2) Ingenious work,- 

I was much struck with the fresh- 
ness and ingenuity of the attack of 
the MacKinnon group* The. van- } \ 
ables P» 0, S certainly have the 
merit of common sense* The Gough 
Adjective Check Test seems a ■ 
promising device. It would greatly 
simplify evaluation procedures if 
ti^fWividusl should turn out to be 
a fail judge of 'himself^ In this 
case much of the torturing conhi- 
/fton^rVounding the use .of/ prp- 
jective te^ta/ might' be avoided. 
Through theV use of this test* the 
stimulus "value ^ of an individual 
n be compared as it seems to r 
im and as it seems to others, for 
instance the assessment raters;, The 
concepts 4>f tempo, self-confidence* 
e-perspectivef and critically 
seeragach and all sensible and use- 
ful./lt is especially interesting that 
the V Belf-jftrcept ' , ratings suggest , 
these variables, I shall try later to 
outline a crude theory which would , 
give a setting for them. 

For my part, the suspicion that 
aesthetic judgments shoumVbe re* 
lated to high or low P (potential 
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success) is startling* It is probably 
due to my lack of information in 
this *area that I cannot understand 
how the writers would have hit 
upon this flWian, However start- 
ling the suggestion may be s it is 
evidently a fact that high Art Scale 
scores on this test coincide with a 
somewhat gloomy and cqgpfeig view 
of the self while low scores identify 
more peaceable characters. One 
has the sense that somehow cultural 
variables have created a ^built-in" 
correlation here, and the same logic 
applies to the painting test. It is 
'also interesting, but mystifying, 
that these perceptual preference* 
are observed abant equally fre- 
quently in those rated high and low 
on potential success. 
Every scientist will share the hope 
hi the authors that simple tests 
'can be developed which are related 

■ *to the* results of molar assessment « 

procedures. Again I find myself 
startled that high scores on the per- 
Cpplual^cognitive tests should be 
related to the adjectives checked by 
afjj^smeD# raters. Those making 
high%coris are apparently assigned 
"good" adjectives while those 
making low p-c scores are assigned 

■ "bad" adfectjves, S (kin e thing, 
strange and unexpected must in* 
deed , bfe^operating here. At any 
one time one may be' resigned to 
the fate! ?' cofrelation but eventual* 
ly onA must know more about this 

- remarkable connection* 
(S) Evidence of good method. 
This hardly needs stating in this 
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^ congregation. Knowledge of test 
construction, while not common, is 
evidently at hand among the per- 
sonnel of this operation, v ^ * 

f (4) Murray's work, [.-* 

It pleases me greatly to see the 
imaginative work of Henry A. iSur- 
ray continued in "this project* That 
"work is reported upon in a book 
by him and his associates, "The 
Assessment of Men/' With marve- 
lous common sense Murray assum- 
ed that those assessment procedures 
should have greatest validity which 
most neatly approximate die; cri- 
terion situation, Least scope. would* 
than be" 'allowed to unpredictable 
generalization of rtsponse* <®ne^ 
has the stubborn sense that Mur- s 
ray's work is on the right track 
even though at the moment some 
I of the conventional testimony to * 
reliability ami validity ^ absent. 
It is evident thjt the / work pro- 
gressing under MacKinnon and 
asgociate# preserves thej Murray** 
impetus while ^improving on tly 
improvised technique wfiich was 
forced u^on Murray by jvartinft 
-pressures. ^ * 

Negatives, & 

I must perforce and pro forma say 
a |ew filings 00 the negative side. 
Actually fell that I have to say is al- 
ready covered by Dr. MacKinnon's 
disclairner as to the pjfcvisional char- 
acter of the wArk, {A am fairly cer- 
tain ithat he s and his group would 
agree with the technical criticisms 
I* am about make and am reciting 



them more or less as a necessary part 
of the scientific Jitany, 
'■ ( V) The nature of the assessment 
procedures (that is, the Friday to 
Sunday observation period) 
■ •• should* , of course, be -more com- 
^^j|eteiy^deicribed> _J ^ouJd like 



/ 
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T»e reliability of the* self - 



instance, to know about ratei^ 
^ej^^hity on the trait of "likeable- 
ness which is mentioned in the 

text ■ 

(2) * No indication is given of the f 
reliability of the ratings , provided ■ 
by the jhree instructors on the 9 
characteristics E| O f and S. One 
assumes that such ^ratings must be '.* 
rathe^ reliable or they would not 
be reported ;* or, at least, that the 
path to greater reliability is clearly 
seen by the writers, 
•(3) 

ratings in ^he adiecji^e test would 
also have .. to gjpe* demonstrated. 
flBbvio&siy a testis of little use if 
an individual dfeseiihes himself in 
vne^yy on Monday and another 
on Wednesday, 

(4) Similarly, how congruent are 
£\c ratings of assessment raters in 
regard to the adjective test? 

(5) Of course the matter of the 
Validity of the self percept ratings 
must also arise, There is some 
reason to think that the account an 
individual gives of himself is a 
kind of * 4 story" which he isks 
others to accept It is the set of 
opinions about himself which make 
him least uncomfortable* Is it this 
set of opinions which is revealed 
by the self-percept? ^ 
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III die course of therapeutic inv 
terviewing I have> seen people 
whose self-percept was distorted in 
a complimentary direction. I have . 
ajso^ surprisingly j, seen people who 
Undervalued and underestinfcted 
their knowledge^ ^skills and 



strength, The^e people I . speak of 
may have been unique in the World, 
but K"doubt it. People* get little 
!* formal training in rating them- 
selves. If ffieyself-pereept is a re- .; 
flection of the evaluations and rev. 
Ksponses of other people these too 
vara frequently distorted. Rival 
• sibling arid professional, can 1 
{to marked mis-evaluatioh »by Qth< 
people which wolilb^ 4 presumably be% 
reflected in the own selflpereept; 
f-t Are the Variables of .tempo, self- 
- M confidence^ etc., independently es- 
v / taMiBhed or are they, explanationsY 
y- * tof the ratings which people give 
^themselves on the adjective teat? 
V,' If they are explanations, they real- ^ 
\ /£'ly have the status of hypothesei aW' J 




icerning 



of nature and when used with die-' 
crimination can/ be serviceable 
despite* its lack of rational founda- . 
tion. ■■ w;.y;< 

the CrutchfieM 
cognitive) ^test 

Senti ta^ppingj 
fchare with the 
some such 
^tshbe're^; 

M 



pitales, wei* 
Street Gestat 
authors the hb.pl 
simple test wilj 
lated to yariableM 
more complex met 
fnenl However, ^uantfeaj 
hope is less than theirs. * 
Slave liked to\ know Hbv 
^rirtkage there was in, 
a tion procedure whf 
these 4est§ were " 
0, and S rating^ 

actually existl^fflfwii 
p§ven in: the pr^ir^nairf 

i hand, _ . : : ■ V^^Vil'.^-"-'-«S 
fflff problem of thef*valida- 



shoild lead to* f 
testing, 

(6) Concerning 
between the two a 
two types ostein 
can be referred to, 
as "gloomy" and ^giprtlc 
the naive feeling/ 1 
these two scales are m^as 



empirical g 





S^^p^th^ p-c measuw^iV^ 0 

^.crucial one^ ft/ is/sug* ; % 
slfea iff jSW MacKinnon's ' paper . k *J 



Relationship 
:s and the 
;Which 
pose, 

have* 



that* tfrW researchers hop^that ihe;\ 
feat wilt be significantly f6latc4 0^ 
adjectives checked by the assess- ^ 
ment rjaters, Lfi us suppose tot 



this relationlh% were 4 high* ,Th#re 
would stiH 45Q the* prBblg^of h^w 
jvelljasi^ssment/ ratings'* wer^ "ifc- 



series oy^oifne 



well^s^ssment' ratings'' wer^ "ifc- tf 
•latgf} *t (factual later 'Wc^ess>" \ \ % ■ 
4iniilar*' problem exi|£f wj^ 
now .tta^oufht & dV » .jrifgard. to the P, 0, and S ratings 
r^tip^^e^ls^4on^ %^fnafle by acadenlic^structom^ of " 
^dt provid^in Dr. Mae- \-. graduate student .ftmcto. Vslida- 
r ; Ho^&yer I weir \ tion in tlfircase^ouid- have to cort* 



t a correlatfonj is a; 



facf • sist of!e%jence of teal Ijfe success. 
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# ) scientific originality and personal 

* .,..1... ovar Hma, No evidence 



is offered concerning the ultimate- 
Validity of either the assessment 

, raters' ratings or the instructors* 1 
ratings. I 



I repeat that it is my/ belief, with- 
out consultation with Dr, MacKinnon 
or his colleagues, that they have been 
saying to themselves more 4 or less the 
same things that I have just been 
saying: If I tried to answer the lore 
going criiieism f I would say* some 



The making of 
menta i|> ^ laborious task, 
have [ every help available, 
sense is a great jfsset if tl^e ^searchef k - 
can produce it " Thejre fer 'only *qne\ 
thin^e^erx. thBtit'a general theory 
. of hUinail_be^yior «ndire^tion^_ 




Whst^s have to # ,.say here^ is there- f v 
forey rnpre of a jppmmentf, on' test*, 51 
malfing? in general than it is? ion the 
specific work 9 of tije .MacKinnon 
group. ^Itseei&s to me that our £rea- 
tiori of signi fleam? tests is hampered 
to a'" ofegree we ^o* not fully fealt 



thing like this: I^et these fello>vs alone, by tlje disorderly additions jire^ali*?:* 
Give .. them. time. They m re . at tne ing w i n % e^a vilS- theory generally^ 



h'egiyming ' of a difficult task . whose 

; difficulty ; they recognize. ' They un- 
derstand scientific procedures and are 

^ carefully, arid loyally following thern; 

, t)on ? t ask them to face problems 

; yhiclj they: have not come to in the 
orj&eriy • course of events. Accentuate 
the -positive, for there is much of it. 
Let your* discussion have the realism 

.■of .a colleague who actually fades 
the difficulties of original research 
as 'well as recites them. Don't pile 

* thf burden of criticism so high that 
the researchers can do; nothing but 

l > retird to Berkeley kt\t take up beach- 
combing or j Russian , roulette. In 
shorty remember /your own trials j as , 

;a, researcher and Have the grace to 
lead a cheer for MacKinnon^ and 
(Company. • ' 

I have decided to accept this ad- 
vice, omitting, for the moment only* 
the cheer, 

. Can better theory suggest tests more 
likely to succeed? 



Very often the test rniRejr is/» a spe- ^ 
cialist <^n tne. tfehnicaLoperatiou3 in- ft 
volyed m dgsigpiing^a test but is lack^ 
ing in* sophiiticatipn' iboflt personal- 



id humane and 



ity. ! dexck)pn1enrf 
social 1 behavior, \ 

1 For £X&raglc, -.J^gget the serife tffet 
the tester^is\freq^ntlyl^ \ 
warily ^Toilful hii%ubjecL seefjpgonly 
the external^ asrJects ol /nis. behavior^ 
He may tr^ a*s it 'wetfej to'study mari* 
without letting him tal^lesr^ some 
the : .exoc L cise.-of jWs cjiief .human 
ity sHBld* r^sr^te *Qjelude#the re- * 
searcher, i T he practical implication 
of what I am^i^nglto thar some 
use should certainly be fpund^.fijr^thV^ 
* interview in JjJ^ kind of assesment 
procedure whieu deals^wfth the higher 
mental jfHfc .of* fl|an* Mil? has We 
eapacit^not. only ti 



report on Jfim- 
self, to give' hi|^ pjeiCT^^*v|^ of 
als^ to Itself 
finking 4nd thus to pro* 



himself, bt 
acting arid 

vide invaluable data for^ ^jglssment, 
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Very likely the further development 
of tjie Murray procedures will ex- 
ploit, this capacity to the fullest* 

Howevey^I/am not speaking for 
mere soph^tioation, although such is 
certainly .'fetter than distance; and 



the physiological and anatomical aide 
the differences between men of any 
race or culture are minuscule* Their 
bodies are rigged and wired in sub- 
stantially the same way. Apparently 
they learn in the same way, Funda- 
mental drives are at least more or 



There is every reason ttf believe that 
human behavior is lawful and orderly* 
If it were jhot, the existence , of a 
society would b& impossible. We have 
as yet only a : dim inkling of what 
these laws may/ be or how this order- 
liness, intuitively perceived, is ar- 
ranged/^ 1 , .. 

As you know, Neal E/Miller and 
I have been working wiffj^the laws 
of learning as a form of systematic 
explanation in this field. Our rea- 
sons for being hopeful aboiit learn* 
ing science are several : The first is 
that there is a large body of experi- 
mental evidence on learning and 
some over-all agreement as to theory. 
For example, practically every experi- 
menter of consequence believes that 
habits can be learned under condi- 
tions of drive and reinforcement; 
differences might exist as to whether 
these are the only conditions under 
which learning can occur. However, 
so far as the general public of science 
is, concerned, there is a considerable 
body of theory on which there is 
technical agreement, as well as a 
^smaller body of theory which is still 
under experimental- debate, ,' 

The second great consideration 
which makes us look hopefully at 
learning principles is a type of cross- 
cultural analysis* We know that from 



less similar; The differences in skin 
color, hair form, and the like, which 
•are so highly and* dangerously cher- 
ished in; the English-speaking world, 
are unimportant from the physiologi- 
cal and 1 anatomic standpoint One . 
rnay say, therefore, that the men 
with which culture begins are the 
same, ' 

But looking at the scene of adult 
behavior,, one finds an astonishing 
variability. The three thousand diff- 
erent societies which have been iden- 
tified Ify anthropologists produce 
three thousand different kinds of in- 
dividuals, characterized by different 
food appetites, different sex habits, 
different economic practices, differ- 
ent senses of guilt, different objects 
of fear, and a multitude of other diff- 
ering traits* 

How can it be* then, that from a 
single kind of man so many different 
patterns of adult habits are pro- 
duced? Our answer to this question 
is that these habits must .be learned, 
Research has shown, furthermore, 
that there are a few. powerful princi- 
ples which account for such diverse 
learning from the single substrate. 
It is this consideration which especi- 
ally focused our attention on die 
learning field in Psychology and 
which makes us hopeful that a better 
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understanding of learning processes 
will lead at one and die game time 
to a better general understanding of 
human personality and social rela- 
. lions. 

We believe, as a result, that the tor- 
— tured-tegters r 666Hng to-gat^a4aborA- - 
tory grip on the slippery eel of human 
personality might dp m well to learn 
thoroughly what is known about bu- 
*' , man learning » and to seek, in these 
• principles of learning, stimuli which 
will indicate favorable variables for 
testing or favorable situations for 
evoking such variables. 

Since we -have not set ourselves th^ 
task of creating such measures our- 
selves we cannot be certain that the 
use of learning principles would be 
an economy in devising tests. It 
hardly seems credible, however* that 
they would not be more serviceable 
than intuition or common sense, 
Principles which appear with so much 
order and coherence in rats* dogs, 
cats, monkeys, chimps, children, col- 
lege students and Ph.D*'s could , not 
fail to be suggestive in the measure- 
ment field. 

An attempt at application. 
* I would not have it supposed that 
I am any less willing to stick my 
neck out in a venturesome project 
than is Professor MacKinnon. The 
critic should have no less courage 
than the creative scientist, I will 
therefore make an attempt to make 
a brief behavioral explanation of ti^e 
variables tempo s self-confidence, and 
time perspective. This will necessarily 
' be an ex posfc facto explanation since 



ROBLM! 



it is Prof e|^or MacKinnon whp has 
evolved these descriptions* I think 
it is possiblej iToweve^, that with an 
adequate knowledge^ • §f learning 
scien^Lpome of them might have b^n 
surnApd before a test based on hunch 
had shown tlieja^to be related. 

First as to tW&pQ. This is described 
as a stable rhythm of activity in the 
students who were rateciWiigh by their 
instructors* Presumably their activ^ 
ity is less variable than the low-rats 
ing students and less responsive to 
immediate stimuli of discouragement. 
Let us remember ^that the tasks of 
the graduate student in science and 
medicine (though to a less degree 
in, social science) are laid out in 
serial order. ^ First units are learned 
first, teaming of second units is 
based on proper acquisition of first 
units* etc.j very much as one must 
know arithmetic before one learns 
ajgebra and something about the use 
of equations before one learns cal- 
culus, I should guess that a student 
whose activity unrolled in an un- 
ruffled pattern would have a better 
chance of acquiring preliminary units 
in the? right order and would thus 
make steadier professional progress* 
Students whose f rhythm of activity 
was more variable might miss out 
oh necessary elements in the serial 
pattern and thus be disadvantaged in 
later ltArning.. 

As tp setf-confidence. This trait is 
presurrWHy bafjpdon past successes. 
The student hajBTesponded /in the 
past, beearewaiitld, has learned, and 
this tranlSbtion has left behind a de* 
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posit in his character. In, the Miller- 
Dollard lingo, we call it "hope,** 
Hop© is a self -administered reward. It 
can bind into place the activities of 
an otherwise dull and frustrating day. 
It can be attached to such ^thoughts 



evoked by the prospect of a distant 
failure; and similarly » to enjoy and 
relax in the prospect of a remote sue* 
cess* The stucjent who is correctly 
time-oriented is therefore much more 
autonomous as far as his professional 



way* anttift had with learning's concerned- Hjfe^Rjfe 
the good," or ".Now Tin half way distractible by immediate stimuli, arid 



through," or /Tve been through it 
M before, and it came out aU right," 
andfSb forth. This type of self Reward 
can bind the activities of, daily life 
into place and enable the student to 
bear the long years of training wlych 
are required of modern professionals, 
We should suppose, therefore, that 
self-confident or hopeful students 
would learn better and therefore 
would merit BetSer assessments of 
likely success. 

In regard to time-perspective* I 
have emphasized thejength and often 
tedious character of the learnirfg re* 
quired in years of professional prepa- 
ration. In this connection time-per* 
;spective can functionate motivate the 
•Student when near stimuli do not 
have this effect. Possessing adequate 
time sentences, if you will permit 
the expression, enables one to use 
motives in the present time which are 



is able to motivate and reward jbini* £ 
self. He should, of course, IwSfJ bet* "<>• 
ter and get better ratings, > 

Naturally I am far irom satisfied 
with these systematieosuggestions, I 
have simply been, trying to say 4hat* 
soml of the actual findings do ^eem 
to follow fairly naturally from a 
learning analysis of the situation in 
which the professional student finds 
himself. I trust that the analysis is 
somewhat plausible because I would 
wish to strengthen the hope that test 
variables could be selected iiNi more 
orderly way if test makers nad or 
used a better general theory of per- 
sonality,* I think it further to be in 
the interest of science to suggest mat 
the learning and over-learning of the * 
elements of present-day learnirtg sci- 
ence might be of real advantage to 
the maker of tests* 
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The Development of Useful Tests for the 
Measurement of Non*InteIleetuai Function 



S I L VAN TO M K I N S 



A -DISCUSSION OF "PERSONALITY STRUCTURE AND 
PERSONALITY MEASUREMENT" OF R. B, CATTELL 



Cattell believes the educational psy* 
chologist is to unimaginative* the 
clinical psychologist is too imagina- 
tive, the experimental psychologist 
, land his methods unattainable and, , 
7 that since the earth is without form 
^ and void an4 darkness dwells upon 
the waters, salvation can only be 
found in axis rotation, I believe that 
the flood can and wij| inundate test- 
ing, psychometric and projective, and 
factor analysis alike, unless all of 
these are revitalized' By theory and 
expjerimenk If it were true that edu- 
cational personality tests are trivial, 
projective tests wild, experimenta- 
tion impossible then factor analytic 
techniques would in fact command 
an inflated value on the psychological 
bourse* We are not faced with these 
options* Tests, questionnaires, in- 
ventor ies, projective techniques can 
be salvaged, Experimentation is pos- 
sible and its area can he continually 
expanded. 

Let us consider first the matter of 
structure versus measurement. Cat* 
tell has said "Indeed, although the 
hocus-pocus of the patent medicines 
may seem superficially to lie at the 



opposite pole from the, honest, ant- 
like industry of the itemiiers, the dift\ 
erences are of less importance than^ 
the similarities, What they have pri- 
marily in common is a complete dis- 
regard of the necessity for discov- 4 
ering a great deal about personality 
structure before beginning to put a 
test together," I agree entirely, It , 
has been characteristically American 
to measure first and ask questions 

later. But we cannot blame it alf on 

v 

Americans. Biiietwas a . Frenchman 

and Rorschach a/Swiss and these two 
began the teftingNqriGvenient, Measure- 
ment has outrun theory for a simple 
reason. Psychometric and projective 
tests-had their origin in and owe their 
continued support to the needs and 
demands of service agencies, educa- 
tional iftstitutions and mental hospi- 
tals and, clinics, Binet was asked to 
predict scholastic achievement not $t 
construct a theory or a test of mtelli- * 
geftce as such, Rorschach did not set 
himself the task of constructing 
either a test or a general theory of 
personality* He was primarily inter- 
ested in the differential^ diagnosis of 
the mentally ill, Both testing move- 
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ments haye straddled thii issue with 
varying degrees of discomfiture ever 
since. TTiere Jiasibeeh ah enduring 
interest in th^jedietiofl of scholastic 
achievement afid at the same time an 
unwillingness relinquish the notion 
of the measurement of a theoretically^ - 
more, remote cQnstruet*"inteUigence." 
The projective testing movement has 
been equally troubled. Tt has not. 
wanted to divorce itself froTh the gen* 
eral theory o£ personality, and yet 
feels it must bejesponsive to service 
needs— *-is this person a schizophrenic 
or a depressive patient— will he re- 
spond to therapy— to what kind of 
therapy will he probably beet re- 
spond? These ar» practically import- 
ant questions. We do not know 
whether this is die type of question 
the personality -theorist should ask. 
We have misgivings when projective 
teat results are used to^tolster a classi- 
fication of mental diseases that ip ad* 
mittediy; obsolete^ But the projective 
tester aijd the educational tester feels 
committed to answer questions wheth- 
er or not he haa* posed the quesfijtns. 
Both psychorrilfrie and projective tests 
were ultra empirical* in design. In 
both cases one knew what one* wanted 
to predict and ^experimented with 
items, and ink blots until they did 
in fact predict. Each type of test was 
almost equally unembarrassed by 
theory. If one achieves a certain de- 
gree of success in a venture of this 
type then die obpous next jtep is to 
do a abmewhat better job. What 
seems be called for is more pre- 
cision Wd then measurement begins 



to outrun theory. Why did neither 
movement sustain an inquiry into the 

nature of "intelligence .» and personal- 
ity? My guess is that this did not 

' happen because of the success, of both 
psychometric and/ projective tests. 

^poTf"bTe^ds^Timar11y on 
tual dissatisfaction. Let us make no 
mistake- about it — these tests ex- 
ceedingly powerful instruments, r The 
intelligence test yields us information 
wbich might omerwJjQ require a few 
years of observation. A. Thematic 
Apperception Test will yield informa- 
tion about an individual which very 

intimate friends^may not acquire in 
the course of a lifetime. Those who 
are unfamiliar with the mentaVndspi- 
fal and clinic are inclined to^mder- 
estimate die amount and quality of 
feedback information whieh^is, avail* 
able to the clinical psychologist. 
There are literally thousands of in- 
stances in which a projective test has - 
enabled the clinician to understand , 
and predict the course and outcome 
of mental disease and therapy. This 
feedback is neither as systematic nor 
as reliable as the type of information 
we obtain from a well designed ex- 
periment—but it is frequ^itly as 
good, and sometimes better than die 
information derived from experimen- 
tal or statistical surveys which are 
not so well designed* Jt is this very 
degree of predictive power of both 
psychometric and projective fc tests 
which I would hold partly responsible 
for the condition which Cattell and I 
deplored It has in effect taken the 
urgency out of the theoretical ques- 
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tionfj—what is the nature of intelli* hears some prejudice against ^ro- 
gence and personally? It would A. I jective techniques* By prejudice I 
submit have|been a* better thing If refer to the- state of mind which re- 
bat tiie pSychotpetrician and pro- quires a certain levil of confidence 
jeqtive tester had iriltially^failed in to believe one kind of theory and 
his efforts at prediction of a firiteridh, another level of confidence to fie- 
It is this purely empirical, a-theorefc- lieve a different kind of theory. 



cal, criterjpn-ljound characteristic 
which is responsible for the low es- 
teem in which the whole testing move- 
ment is held by the parent science, 
The tests are/ not ^ rejected on the 
grounds of low validity— they are in 
fact as Stolid as mosx theories are 
true* Jt is rather because even when 
"valid they contribute soJittleito the 
general fabric of the science. The 
clinical testing mo vement is today .un- 
dergoing the same type of validity 
soul searching as the .psychometric 
testing movement experienced a gen- 
eration or so ago. Does the Rors- 
chach M response really mean inner- 
life — do the great scientists really 
have an unusual number of such re» 
sponses— m color shock really due 
to the color of the plates— let us take 
the color out and find out These 
and a host of similar questions are 
providing Ph.D. thesis material for 
our ^young clinicians. You may say 
* f it f s about time*" I would disagree. 
Errors of interpretation of projective 
tests would jir the long run harn^ us 
less than ^he diversion . of our main 
energies to jproblems of test vaiiela- 

Hon,' ' 

- -5 * • .' 

Alfhough;J agrte with Cajftll that 
measurement is being overerilPhasfled . 
in die entire teaRng movement I can- 
not J escape ' trf^ impression; that he 



Consider his statement "How hollow 
this claim is can be seen from Thur- 
stone's finding that the Rorschach 
measures touched only one out it 
about a dozen factors found in per- 
ceptual responses*" Jle might have 
cited many other studies exposing 
low validity and as many that were 
on the positive side but he chose to 
emphasize the negative findings and 
to present as negative a finding which 
reads in Thurstone's (6) monograph 
as follows: 55 The test was given to our 
subjects by Dr, W* A* Varvel, who 
has given considerable study to this 
test. A number of separate scores 
were determined for each subject and 
Dr. Varvel may publish separately 
an analysis of* these Rorschach rree- 
ords, Only two of the scores were 
included in the factorial analyses 
namely the scores denoted Total Re- 
sponses and Perceptual Organisation 
* * . the two Rorschach scores appear 
here by themselves in 4 the doublet 
factor K, The other saturations are 
smaller, and we Have not beep able 
to formulate any hypotheses concern- 
ing the interpretation of /this factor 
beyondf that of the Rorschach test 
specific," It* should be noted- that 
less than one in, ten of the* conven- 
tional Rorscljaqh scores were includ- 
ed in 4he factor analysis. It should 



f 99 



95 



ERIC 



I9S1 INVITATIONAL CONFERENCE 



not be ton surprising it these two 
scores do not appear in a variety of 
perceptual factors. That even these 
scores are not without psychological 
significance appears in the appendix 



we do make valid inferences on the 
flimsiest of 'evidence* We need not, 
because of invalid inferences, scrap 
either the general method or the par- 
ticular experiment or test. We must 



of the iam ^ moM gwp ht tn ff n »% indeed atop drawing incorrect inf# 
Thurstone, reporting a study of cam* A enees irom a particular tesrwhenw 
pus leaders writes "The Rorschach^ learn that we have been making er 



test was scored in seVeral way s» knd 
these scores showed interesting 4ifi> 
erentiations for. the campus leadptS| 
The i leaders excelled in die total* 
number of respotfses^ they were very 



rorsr but we may or may not want to 
stop using the .test, Cattell has called 
projective tests. "Patent medicine 
tests" f because whatever may be 
found -out about their validity , no* 



markedly ' superior in the perceptual light is thrown thereby on general* 



organisation score and they showed 
greater latency for color cards, They 
gaveia smaller number ofc responses 
to the hojg r cards itt comparison with 
the rest of the perceptual battery, so 



able scientific processes. For they do 
not deal with distinct, known psycho-, 
logical processes e, g* rigidity, fluency s 
relation eduction, corresponding; to 
separate dimensions o( .personality 



that these scores cannot be interpreted but claim ;fo reveal the whoje of^per 
by the*same factors as far as we can sonality tnrough a single Jest cap- 
determine at present," In other^ords sule." I agree; that, ; the ^rux of the 
the test was effective disenminating matter is that validity . studies need 
'* one group; from pother, but «nCP not throw any light on generailzable 



onlv two scores were used m the $ac- ; 

-j i i *■ ' p. * 

torial analysis and since these scores 
did iibt seem jelated to> other per- 
ceptual factors— no more titan \ this 
could be said* This would seem to 
me slim evidence on which to reject 
a technique that has been useful for , 
a period of over thirty years, * I should 
Ukfe to emphasize that validity is pot 
S characte^stic of a test and' truth is 
not a characteristic of arj^xperiraent. 
Truth arid validity are tiaj|ft£teristics 



of statements we^ maite Iffitl infer- 
ences we draw on the basis of ex- 
perimental or test data* We can and 
do make false inferences from ex- 
perimental as well as test date and 



scientific , processes— in the case of 
both psychometric and projective 
tests,, But they may be analyzed in 
such a Way if one wishes to do so. 
There; have been', for example, an in- 
creating ^ number of factor analyses 
of the Rorschach in an effort to do 
just what Cattell says' these tests can- 
not do, Shelagh M. Cox (2) J work- 
ing under Eysenck's direction, found 
that the first factor to emerge from 
' the Rorschach was a productivity or 
fluency factor and that there was a 
^correlation obtainedlSetween the cr^ 
terion (normal-neurotic) and the 
jjjrst two factors to appear in the 
analysis of the Rorschach categories 
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of ,78* This fluency , factor wai one 
of four which also appeared in Whit- 
{tenborn f s (7) factor analysis** Cox 
reported M The general factor of pro- 
ductivity found in die present investi* 
gation Jinks up with Petries findings. 
She carried, out an analysis on the 

. interior Ration * of results on tests 
involving die giving of as many re- 
sponses as possible in a given time, 
•Such tests included responses to a 
black and white Rorschach ink blot* 

^MWimber of^rftuhd things, trees, things 
to eat, etc, A general factor of fluency 
was identified. This factor had its 
highest correlation in number of re- 

"sponses to die black and white Rors- 
chach blot. This, can be compared 
with die high loading of number of 
responses or the general -factor in 

* the present study* A similar factor 
was identified by Sen with Indian 
adults, 7 ' This latter was also a Rors- 
chach factor analytic study. The point 
is that there* is nothing about any 
kind of data,* or test which necessar- 
ily dictates the kind of analysis one 
may make of the data, or which dic- 
tates the purposes for which this 
analysis may be made, I would how- 
ever agree that if one's interest in 
tests is to be theoretical* test construc- 
tion should in the first instance be 
inspired by the theoretical interest. 
But you may say "that would not be 
test construction that would oe indis- 
tinguishable from pure experimenta- 
tion," TKat is exactly my point — that 
today's tests are poorly designed ex- 
periments. They answer no one ques- 
tion very well, They typically ans- 



' wer too many questions* yielding too 
much information %o be useful in die 
reconstruction of^what has gone ifi^ 
the process of responding to die tdst; 
Many tests resemble defensive camou- 
flage, The^ present information in 
such a way that one is fairly certain 
not to be able to use it to apswer 
very searching questions, Implicit in 
my criticism is the assumption that 
the test should be more thaii a mea- 
suring instrument of a single variable 
or factor, A good measuring instru- 
ment, let us say a psychological ther- 
mometer or voltmeter would I 'think 
satisfy most testers, including Cattell, 
who would use factor analysis to dis- , 
cover the basic dimensions and, then 
devise ways of measuring die pure 
factor, But this is, I submit; too low 
a level of aspiration for the testing 
movement, The fhemorneter is a 
wonderful measuring instrument, but 
is not likely to yield t a theory of heat, 
nor would a voltmeter yield Ohm's 
law. The more usual situation is one 
in which a theory and a lawful rela- 
tionship are used as a basis for cre- 
ating measuring instruments, A group 
of * measuring instruments ^tnayj on 
the other hand, be necessary to dis- 
cover laws — but in the personality 
field our problem in general is that 
we have too many things to measure 
and we do not know which variables 
will be die important ones, and what 
the important relationships between * 
variables might be. Shall we nse phy- 
sical models, or models such as chem- 
istry has found useful in organizing 
organic §ubstances or what? Factor 
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fc analysis, ir^we have been lucky method has two hands — contralled 

enough to include the appropriate experiment and statistical analysis; of 

information may tell us what are the the uncontrolled. I agree, but if it 

important dimenflioDJi. But from that. has no *braM it will be lim ited \%Q 

point on we are on bur own and it is scratch , reflexes % no matter tow re* 

not a short distance from that point fined, its statistics or how shiny its 

to our goat Not infrequently however brass. But how can one combine 

we are ho^altogether sure what this theory; and testing? 7 How- can one 

- dimension is. It seems to 4)6 some- experiment with 1 * a test? I am at the 
thing common to nfarry things which moment working on a theory and a 

•■ seem different What Is called Jor is test which will test the theory. 1 am 
an inspired guess, I would? suppose , concerned with what strikes me as an 
that if one were capable of making 1 ^important difference between two 
&at mspired*guess' at the end of the kinds of people both classified as 
factor analysis, it is not ineoneeiv- psychotic. One kind of psychotic be- 
able that one might . have made it gins at an early, age to experience 
before, -difficulfies, with progressive deteriora-. 

\ The testing movement has taken f Hon involving more and more of^ die, 
little respdhfibility for conceptual \ personality* He is likely w to be instt*. 

f ^^pdels^ GuUiksen (4) has maele an tutionalized and spend die remainder 
» ^pjportant suggestion I believe, in of his life in a mental hospital, The 
his concept of intrinsic validity, I ' other type of psychotic is given to 
would urge that testers, psychometric occasional and sometimes periodic 
and projective, tafeeMhe next obvious outbursts of violence, depression or 
step — drop the concept ot^yalidity al* elation. Such a one may be in and 
together, and concern themselves with $ out of mental hospitals or may be 
the truth or falsity of their ideas and hospitalized only once or tw,ice, but 
assume the scientist's general respon- is normal between episodes, The 
sibility for the generation and test- nearest diagnostic- labels are the' 
ing of important ideas, devising tests schizophrenic and manic depressive 

■ * in such a way that they are indis^ psychoses, Both groups seem much 
tinguishable from experiments — so concerned wiih the problem of vio* 
that one test leads to the formation lence. How is it possible that the 
of another in the way in which one same problem could result in such 
experiment leads to another expert .radically different consequences? I 
merit I am suggesting that an ex- entertained the hypothesis that the 
periment can not be identified by manic depressive is primarily con- 
the nature of the material it employs cerned about controlling his own * 
—brasses no more appropriate for aggression and that he feels guu£y 
exTJeiimeritation than paper and gra- when he does express aggression ! *tit> 
1 phite. Cattell has said that scientific even 1 when he feels hostile— further, 
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that ha is able to emerge from periods evidence supports the hypothesis* If 'a 
of atonement and then lea<^a normal schizophrenic denies that' there is any 
Ufe s for a while* The schizophrenic, fighting going o/i-in one situation he 
X had reason to believe* was more denies that the%nah's finger Is bleed- 
afraid of the physiml^o^i^er asgo^^ ing in- the- other situation- If ^e- ex-- 
ciated with the expression of aggres- ^ggerates the intensity of the fighting 



siori, whether that aggression was ex- 
pressed by himself or by another per- 
son. The schizophrenic remains anx- 
ious because ^ he avoids situations 
which he might ^ave learned to mas- 
ter* Witlfadrawalj the psychosis it* 
self, is ^ Stable adjustment because 
it proles the schizophrenic from 
'the ganger pus situation and diseour- 
agesVrelearning, The manic-depress- 
ive is the instrument of his own par- 



one situation he also exaggerates 
le seriousness of the physical in* 
jury* The manic-depressive distorts 
the fighting situation just as the 
schizophrenic does, but his interpre- 
tation of the situation showing physi- 
cal injury does not differ from the 
normal interpretatiom If these find- 
ings should receive further confirrna* 
tion one would possess at once a test 



and a theory of the nature of the two 
tialeure — he punisVes himself or gets major*syehoses, One should then 
himself punished and as p his punish- proceed to improve both nhe theoiy 
merit increases fe his guilt decreases and the test— an fe d not standardize one 



until he is no longer in an elated or 
depressed state* He is normal and 
free again toljaggress until his guilt 
becomes intolerable* Such at least is 
my theory. One can test it by projec- 
tiife technique* One can present two 
types of situations for interpretatiorv 
In one a group of people are shown 
fighting— in , another a person is 
shown bleeding from a physical in- 
jur/* ,If the theory is correct the pic- 
ture of people fighting will be dis* 
torted — either exaggerated or mini- 



and experiment with the other, Ad- 
mittedly one does not standardize 
theories— why should one k either in- 
vite or reject the likelihood of obso- 
lescence by a double standards for 
theory and test? Only on the assump- 
tion that a test is a measure of a single 
parameter* that it is the best possi- 
ble measure of- that parameter and 
that it is the best possible ?pa¥ameter 
to measure. I would suggest first that 
a test may^ measure more ^h^n/one. 
parameter, that the adequaep*oi the 



"mized (eempared with normal con- measure Ms a function of the ade- 



trols) by both groups but that the 
jnanie>depressives will be normal in 
their interpretation of physical in- 



quacy of the underlying theory and 
what we chpose to ^measure will de^ 
pend first on what we think may turn 



jury Whilf the schizophrenic wlll\ex- *out to be important but what we con- 
aggerate or minimize physical injury- * tinue to measure will depend on 
covarying with his interpretation of whether these measures yield us im- 
the fighting situation. Preliminary portant functional relationships, How- 
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ever, what we come to" regard as'.im* 
portani will depend 'on our level of 
i aspiration. In short t am recommend- 
ing thar> we tegari the test as* an ex- 
pelfiTn^fir-designQd to confirm^pr^Te^ 
jeet a hypothesis rather than simply 
a measure of a single parameter. * 
^ Now we arrive at CattelTs third 
assertion^ M sinee there is very little 
of the total personality in Its life 
situation that can bf brought under 
brass* instrument^ 'controlled, experi- 
mentation, the verification^ and ex* 
tension of the existing hundhes about 
personality structure * will in my 
opimdW'be brought abouHargely by 
statistical methods^^articulafcly our 
hope lies^ that wholistic, simultane- 
ous structuring of a great rjdmber of 
variables which we call 
sis. f? In another eontexi 
"For many years I have fceen arguing 



^or analy- 
e has said 



perimental , psychology Jias only re- 
cently recognized the role of "per-- ,^ 
sonality*' m "perception.*' The per- 
son not only can .be studied in the 
laboratory— he-ha§-been-for^a-Kuh^~r 
dred ■ve Brp.^ H ie V extension of me 
scope of such stua^j^pends upon the 
extension first of theory and then of '■;_/■ 
techn ique-Mh eire need be no real 
limitation in either direction.' But 
there isVsomethirig more to CattelPs 
misgivings about the laboratory studv 
of personality. First, he ideritines^the 
laboratory with tlie brass instrument 
—an unnecessary limitation upofi the ; 
possible paraphernalia of the well 
e q u i p p e d personality laboratory, 
which may possess couches and pic- V 
lures as well as jjrass. Secpntl, there 
is^he implicit assumption tftat nature 
4n the raw, must somehow be trans- 
ported btfaU^ihtp the .laboratory in 



personality test work for the per- "Soxdet to study personality. It is as 



sonality oneTmd indivisible, by which 
* I mean that the individual who en- 
ters the factory, the scnool, the home 
and the clinic is om and, the same 
person, and if we ire working on 
/true conception oi personality struc- 
ture we. should hm measuring the same 
factors and Wng the same tests *iri all 
of- them.'Vyne should not entertain, 
both>df^these propositions at once. 
If flie person in the clinic is tM game 
son at h#me and in the factory— 
tEfcn he is also the samjuperspn in 
the ^tychological laboratory. It is 
one anotbe same person who^is stud- 
ied in all oTheMe^me^^^pj^choldgy, 
It is a person who perceives, remem- 
bers, thinks and acts even though ex- 



though, for example^people must be 
observed falling , in love . under the 
voyeuristic at mc^pherc of the labora- 
tory if the phenomenon of romantic 
love is to be studied in tl^e laboratory* 
This is ho more necessary for- the 
personality theorist than it is for the 
theoretically minded physicist to haye 
automobiles running into each other 
in his laboratory in order to study 
the dynamics of irresistible forced' 
and immovable objects. This brings 
us to his third assumption which is 
quite explicit — the assumption of< 
wholism as a preferred mode of ap- 
proach in^ personality theory. If one 
means by wholiSm that one should, 
leave out nothing important *or rele- 



[ 104 



J On 



ERLC 




no 

sary for 
should lik 

leeted reseati 



• a v TE S T I N G P R 0 B LJE 

vant when one studies personality I genej 
shffuM agree, but if one identifies aeh: 
wholism witfi nature "in the ra\v," mo: 
that in order to study personality one me; 
can exclude no fact, no phenomenon tell 
no matter how trivial, then I disagree. 
One' must have scope , in personality 
theory and experiment, but scope is 
. not cto be identified with the assump- 
tion that all facts were created free 
and equal and none should be ex- 
cluded from theory construction. If 
all facts are not equally crucial for/ of . theH$?latio 
a theory of personality then we can- ality^SnA int| 
not be certain that the crucial phe- 
nomena may hot be studied under 
laboratory conditions* I 'have been 
trying to defend the possibility and 
importance of laboratory- study qf per* 
tonality. But I would "agree with 
Cattell that an experiment is not limi- 
ted' to me laboratory. Factor analysis 
may be used in an i experimental 
manner as Cattell is doing—^this too 



predict j academic 
one should spend 
eory of achieve- 
a theory of in- 
intelligence is 
mponent riepei* 
iti tpecondly, I 
tentfon to a neg- 
which owes its 
neglect to the restriction M vision of 
the 1 " personal^ '* - and , psychometrip 
testers, This i^ffi& borderline inquiry 
Ips between person- 
ee. ,We are pres- 
a series of studies 
in fthe* relrfioriship between intelli- 
gence and psychophysical judgment, 
rigidity in tanking and general social 
ideology, fiehall (5) has demohstrat- 
ed that fRe m^re intelligent are capa- 
ble of 4io re accurate p^yfchophysical 
judgment Basescu (I) has dej&b'ri- 
strated that the more intelligent shift 
more qaickly than the less intelligent 



ently uhdert 




is profitable— depending upon the** when reinfoTQement is increased in a 
extent to which this type^of experi- 'concept formation and shifting experi* , 
mentation yields cumulative theory, merit. Goldstein (3) has shown that 
My preference is for stafing the theory generalized social attitudes such as 
explicitly, at the beginning of the prejudice are inversely related to in- 
vestigation and devising the tech- telligence. 
rjftque most appropriate .for testing 3 Fihally I want to present a^|t of 
Ufr? theory, rather s than loping that 'what 1 hope will be helpful tints to 
if one, pours enough sand through a test constructors/Mhose generll char- 
sieve the gold nuggets will be found, acteristics of personality whicg^seem 
I should like to close with three sets to me moat often disregarded in test 
of suggestions for the personality and , construction,/ Firsf, the principle of 
psychometric testing programs, First, compensation and lapitity of energy* 
inasmuch as both types of testing are Within certain limits the personality 
oriented toward application, a gen- ^ is organized like an army, It has 
era! theory of achievement is urgently .■ ^reserves of energy and uses these 
needed, If one wishes to use "intelli- when necessary, It is usually adept 



r ips 



Jot 



at, shifting these reser/ves now to. one which one parameter has been varied 
place and then another: Wherever and alUther parameters held constant 
the tester ls^-there will the reserves Aq situations other parameters ^ do 
bp likely to be shifted/ Msliai made vary, Any .st eady state changes the 
it very ^difficult to study the effect of- organism radically, heightening tHe 
stresses upon personality and mtellee- dominant gradient and homogenizing 
tual function. My general recommen- the rest of the field* Four, the phe- 
daition is to look, as unobtrusively as ribmenon of restriction of range which 
possible in the rear of the front lines is a special case of gradient enhance- 
-^-in the periphery of the psyehologi- ment. When ; one asks questions or 
cal fi^eid— or after the battle is over— 'calls for behavior under experimental 
in the post -experimental period, <&ut* or test eondjjjjpns one usually places 
ing which a '"debt" is usually being a restriction on the range of stimuli 
discharged. Sepondly, the variability nnd the range of alternative responses, 
of a .personality parameter is the^fcsjie We cannot generalize from test or 
parameter, Again and again psychol- experiment Unless we have a theory of 
ogiifs have followed the will of the thjf effect of such restriction of range 
wisp JK die general parameter — e* g, with respect to stimuli, responses and 
fluency, aggressiveness, etc., only to coding categories and a self con- 
discover that the parameter becomes / scious variation of the restriction of 
fragmented under more careful study, range/ Five, the principle of equi- 



There are no such parameters as gen* 
eralized parameters. This has had to 
be painfully rediscovered with each 
new personality characteristic studied* 
One must think in terms of the specific 



potentiality and equiaetnality > The 
person either has alternative methods 
of achieving one goal, or can learn 
alternative methods under the press of 
test or experiment, Therefore one 



conditions under which the parameter should iipt equate performance with 
appears— its generality and variabil- the underlying mechanism, The lat= 
ity are the critical phenomena of ter can only be fathomed by system- 



study* Only a one-celled organi|m 
could be described by a general para- 
meter or factor/ that is, give essenti- 
ally the same type of response to all 
situations, Thfrd, the phenomenon of 
gradient enhancement. The organism 
is a system such that any gradient 
within the psychological field can be 
enhanced, its influence magnified if 
all other conditions in the field are 
kept reasonably constant, One can- 
not generalize from the situation in? monplace in experimental^study of 



artic manipulation of aspects of the 
test or experiment, for example by 
tests of transfer built into the test. 
Different individuals may have difT* 
erent ways of a^h^eVing the same end. 
One must therefore vary critical as* 
pects of the test or ejep^riment Unit 
these achievements are no longer 
iejentieab These principles seem to me 
a sample of a very much greater popu- 
lation of principles which are com- 
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personality and which should Become 3. GOLDSTEIN, *M. Study, of Prejudice* 

commonplace In tent conitruction . I ^ V '^ ht ^, 

A * •■ 4. GULLlKSENi H., Intrinsic validity, 
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PARTICIPANTS 

Donald W*. MacKi^on, Raymond|B. Cawell, Henry S.Dyer/Lloyd G. 
Humphreys, John F. Kernan, ErjvnN G. Flemmino* * 



DlL AIacKinnon: I am indebted 
to Br; Pdllard for the thorough^jfi 
with which He ' reviewed niy paper, _ 
I appreciate the positive tilings he 
aaid r but particularly I am indebted 
to h?m . for the negative things, the 

criticisms, becaus^ it seems to me, Indeed, we take some pride in the 
.these critiblii^Care likely to ,be the, * fact that we spent more time in think- 
WtSisms that^ou felt as I was speak- ing aboift how outstanding people 
'ing (to you, Jkd these criticisms, ik. become that way, than have -many 
seems to mB,rarise out of ^mijniiider- others who/had ventured upon assess* 



I should like tcf say /that I second 
nearly all of Brj, pollard's emphases 
upon theorizing, anfl I should like to 
point out that we in California spent 
six months doing nothing but theor- 
izing before we saw a single subject* 



have 



rest: icted 
Dver- 



standing for 'which I take* responsi- 
ability- x ■ ^ 

, If I had met Br* Bollard'! Irsf sri- 
' ti^ism and told ^im and you what 
5 happened from Friday afternoon un* 
til Sunday after lunch* many of the 
points which were raised would 
ndt have been made* I 
my remarks," andMven so ran 
time, .to stressing those parts )of our 
pfograrn>*which scop to me to come 
nearest to j^euag the development of 
what the panel title is, namely, "User 
■ ful Teste for the Measurement if Non- 
Intellectual Functions^ these useful 
tests 'being tests -which eventually can 
be /presented in paner a|d pencil 
'•f forte* widely^ distributed, and admin- 
istered as group tests, 
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ing or WstirijL programs* A good 
deal of |nat % lhetormng, and many of 
our thoughts about how .personal 
effectiveneis is achieved derived from 
the work of Mr*, Erik ^rikson, Mr* 
Erikson was at that tirne a member , 
of our s\aff, and much of our theory 
as to how the* individuals we Wert 
studying iMame-the k^8-of persons 
they were* was tvery congruent with 
the notions which Mr* "Erikson sub- 
eqaenriy prasariito in* his book 
Cmidhoorf^and Society/ 5 One can- 
not read 'that book without knowing 
we were influenced bVj ^oth its tfieor^r 
and its cross; cultural data* %m ( 
I am very sorry that I gave any im- 
ion that we, * operated w^iput 
the interview. Not only dj^we have 
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the interview, we had (our interviews, which, I regrfct to say,. did not stand . 

Erij^Errkson .^interviewed, each sub* up in the application ot the question- ? 

jeet *fc^|n hour and a half. In this .naire both our first and^seeond 

> he fei^ JfcP get the individual 1 to samples* 



speak .atout ^the way, as be saw *it s I should like jlsA to poinrout thpt 
, in, which his ego- ancf group-identities I^feel we have in our assessment pro- 
had . beer? developed* * . We had ari^ gram made one further important 
hour-and-a-half intfflftnew on the sub- , s^gp ahead which- I did not have 
jects phrtosbphy . anc^values* We had time to discuss,/ namely, the develop* 
^an • hour interview on the life his^ * n^ent of situational procedures which 
tory, i^id a half-hour interview on** make it possible toyJo^itrok the situa- 
the professional field of ^ our sub? tion so that everybody iy the skua* 
jects, letting fliem tell us why and tion is presented ^with s exactly the 
how— as they *saw it— fhey became^ same kind of stimulation. Out ostitis 
interested in their chosen professional I think we wiibbe ^ble to; realize* at 
• fields. \ did not seport these to you last a ij^at deal of the pro'mftte that 
Because of the Jimita&ons of . timet many of us have felt existed in situa* 
and because, it seenm to\me s inter- 
jHew material (valuable, as it is) is 
I not the kind of material jwhieh \ 
i^ought^it was my assignment to dia« 
cuss .with you this^ afternoon* ' 

With respect to Dr* Dollard's point I should like to qtJbte if there were 
thfit- some' of the dimensions— tempo tithe. There isn't, and again thank 
and self-confidence, time perspective you, Pr^ pollard, * , ' ^ 
w — which we discovered, might have Dr. Cattell: I waht to thank Dr* 
been surmised prior 1 to our testing, . Tomkins for what seems' to me a very 
I should like to point out that they brijjiant and sound commentary* As 
were surmised, and it was just he-^ I said, since I am strongly Interested 
cause we surmised that these miglif to hear also the* critical reactions 
be important variables of personality from the*audience, I jhal| confine my- 
that we wrote items to top them. As self tfe commenting, on Or, Tonipkin's 

remarks* on just two : points. First, 
in regard to the much raalighe(r Ror* 
sehaeh, I should say my objection 
is not to the- Rorschach but tOMts 
devotee^ The^orschaeh is one of 
about Jwo or three hundred tests 
.which are available in the literature 
for clinicians to work upon, all with 



0i 



tional tests^and procedures but which 
locate has pot been realized because 
most situational procedures allow so 
many uncontrolled factors, to operatei 
We have lots of reliabilities which 



a matter^ of fact, we wrote 900 items 
for our original IPAR questionnaire ■ 
and if we had not .written those items 
these particular dimensions would 
not have come out, because you do 
not |pt out of a test anything more 
than you 'put into it We had a lot 
of othei; surmises, some ^f them 
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were to me mop exciting than U^se, about the same' degree ' of psomlie. 
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For some reaion they could not lift havlor and observations on it, and 
their eyes beyond one of them, There- I don't see that by mere continued 

fore 'my criticism is merely "of the .observation of existing data on the 
lcfa4 that it would be, shall wc'^y, eUnical level that w e can hope 
of rum. Rum is a good .thing- in -it- • ai% further thai. Anitotle did. We— 

self, it is only the man who feeds .have got to go out with new methods 
on that and nothing else of whom and more powerful means of Bnalysis 



* one is entitled ,to get critical. How- 
ever, I know that 'fa view of the fact 
that Dr. Tomkins has done wonderful 

u things with, the Rortchaeh, more, in 



and then construct our theories from 
those. . 

Factor analysis along with experi- 
ment is just one way of getting new. 



LUmgJS H1UJ. U»C IWiin,...™, j t V - 

my opinion,* than any other person, relationships *out of which we can 

and in view of, as he*says, the length develop hypotheses; and so, out of 

of our past friendship, V do not think , the hypotheses, theories* Consequent* 
we should allow the ftorsdiach to s ly I agree entirely with Dr. Tomkins 

perform om more fouL deed by sepa- ^Ihat the emphasis it on the inspired 

rating us! ' ; ~auem when you have got your factor. 

The second issue is one of the pre^ 
else meaning of empiricism and the- 
orizing, I think we are in sqme con- 



fusion over the use of the words 
" "hypothesis," "theory," and 30 on. 
I don't mean Br* Tomkins and I 
are, but I mean the general psycho- 
logical atmosphere of the present day, 
seems to be irf confusion. I am an 
t empiricist, I Am for going to the 
facts first and I am, against sitting 
down-" and' dreaming up theories 
from nowhere as has been ve/y pre- 
valent when we have ha<j schools 
of psychology!* each with massive, 
pretentious theories to %cover the 
whole field— without ^having & foot* 
down anywhere in it. The hypothesis 
should arise but? of empirical data, 
but it cannot do so unless we go be- 
yond everyday observation, that 4s 
to say we have had for two or three 
thousand years N of culture,^*** the 
- narrow ,sense, access to hifrnan be- 
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guess when you have got your factor, 
The dozen or factors which per- 
sonalis research has now produced - 
are a dozen hypotheses, each of which 
could, keep two or three hundred peo- 
ple busy for ten years^ These are 
the really new, hypotheses in the pic- 
ture of personality theory. My reason 
for preferring /actor analysis rather 
than" controlled experiment is that 
you deal with several variables at 
once instead of just two. Often a 
theory or a hypothesis cannot be 
operationally defined adequately by 
one variable alone, It is a pattern 
of things, so we need tp turn to either 
a systematic building up of the payrs, 
dependent and independenfVariables 
on the line Dr^^nkins is, doing or 
else take a more global approach 
now possible through* the factor analy- 
sis* , 

Those are" my two comments re- 
garding Dr. Toinkins, but I should 
like to beg leave to make one com- 
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mmt that I think Dr, MacKinnon have expected* and I can see no major 

might have made about his critic, flaw in any, part of hie own proeedf* 

r 3^e latter, seemed to me to get away ure. So, although I am in favor of 

,* with— well, to getaway with murder using learning theory and have ak 

far as scientific method ii con- ways explicitly Recognized what I 



Verried on one point. He said be- ^have called "environmental mold fae- 
cause there are net very marked Jors" t which are to be regarded as 



hereditary differences between racial 
groups and since the patterns of 
^rsonality * and different cultures. 



patterns of change in many variables 
imposed by social institutions, we 
must also recognize with equal ex- 



" were extremely varied, that person- plicitaess that -the origin of ©then 
ality must be largely a learned pat* among these factors- lies in the bi- 
tern and that learning theory is . ology of * the organism, and if Ey- 

■* thferpf ore largely the means of under- ^senck is right it lies * in the* truly 
standing it* Now this formulation *Fgenetic influences. * * 
confuseT* what any statistician will Chairman Dyeiu We haven't as 



recognize as the intragroup and inter- 
group variants. It may be tr^ue that 
there lire no big differences between 
groups but there are big hereditary 
differences within groups and, of 
course, we could always put groups 
together for experimental purpose^ 
by selection of * individuals which 
would give very big innate differ- 
ences between them, _ 

I , stress . thjs because. I think *we 
have neglected the innate side of 



much time as I thought we would 
have, but what time we have is now 
yours. 

DfL Humphreys: A couple "of our 
speakers made the statement that 
measurement has outrun theory, m I 
should like to suggest what I consider 
to be a more precise statement, that 
is, that the accumulation of measure- 
ment devices shas outrun both theory 
and data. > 
Mr. Kernan; I have two very 



personality for the last twenty years similiar questions that 1 should like 



and only this last month there has 
appeared a paper, quite a startling 
paper, by Eysenck from Maudsley 
Mental Hospital. In this very ade^ 
quate and methodologically interest- 
ing twin study in which he concludes 
that something like 60-70 per cent 
of jhe variancgjjLneurotieism is de- 
termined by heredity and only 30-40 
per cent by environment, (I i quote 



to ask Dr. MacKinnon, Fitst, 4s it * 
not possible that significant differ- 
ences- found in the preferences of 
artists versus non-artists is a fultction 
of the fact ihat the vogue in art today 
is^towafd the absurd and ^rizarre? 
.One's personality is affected by his 
teaching environrrroftt and the like. 
Since aEtists are exposed in their for- 
mal art classes, and in their social en- 
from memory,) That is (a very high vironment to the necessity of being 
figure, higher than anyone^ would bizarrej unrealistic, etc, would this 
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not 'be reflected in their preferences 
for these types of pictures and paint- 



factor analyzing the responses on 
lor uiese j^ypee ui [Htniu - au\* p«m* paper and ■, pencil teats is to get w ^ 
-inp? Second, if you used an all non- might be palled a personality" strue. 
T ffllgt po uu hitioi^cwId4io^e^ 

differences between artist and noR- tics. The ^ychqlogist. ^factor 
artist disappear? If they' did; you . Aalyw these tests, of epurse, pub- 
would then be unable to judge per.' M> .'them .nd_«JL them to jb«« of 
a&ali$ %m an anllysis^f P refe>-u8 in industry or business who want 
ences for ' pictures, t paintings or to upe them for. the purpose of sefec- 

drawings* 

Dr. MacKinnon; I should like to 
answer that by saying t would cer- 
tainly agree"" with the speaker that 
the current mode, the cultural values 



are certainly of the greatest import 
*anee in this area, I should* however, 
be inclined to t^ink that these diff- 
erences in perceptual choice, the per- 
ceptual , decision, what it is that in- 
dividuals tend to prefer to see in their 
• cnvironmento, is something whickhas 
a long history, and in the forthcom- 
ing paffer by Frank Bar^afif Barjon 
makes some *exiremely interesting' 
compariiEms between, jhe typology/ 
if you will, which he has developed 
on the basis of his 'investigation in 
this^area and William James 5 typology 
" of the tough and tender minded* #nd 
I think* that these come out again 
in the work which Cyril Burt has 
done. While 1 1 would not minimize 
the thesis you have stressed, I think 
a there are differences here that go 
beyond any single period of time. 
Br, Fleming: I have been very 
1 much interested in the tests that have 
been developed by Dr/ Cattell and 
by Drs, Guilford and Martin which 
have brim a result of factor analysis. 
Presumably one of the purposes of 



tionjoj prediction of behavior. While 
theoretically,* iri*%se tests that have * 
been developed, yoji have Unitary 
characteristics, in that they are fac- 
to riolly pure, or as pure as they can 
be gotten? in actual practice I have 
found/ in tiling the Guilford-Martin 
teats,,, that there is some question as 
tOj whether or not these factored tests 
really meaiure unitary characteris- 
tics. \ p v 

For instance, I have recently made 
an item analysis of the tests of a 
thousand applicants for jobs as sales- 
men, of five 'hundred applicants for 
jobs as sales managers and of an* 
other three or four hundred tests of 
men who are actually employed as 
salesmen and^ratccrj satisfactory or 
better than average r^jbeir rrlanag- 
ers. I suppose theJ^thors of , the 
factored tests, because^ the iactor^ 
are stafistically pure factors, would 
^spy yo\| djon*t need to make an item 
analysis. But in making an item 
analysis of the questions on the Guil- 
ford-Martin tests, I find that there 
are 'some items Vvh ich salesmen and 
sales managers ajrswer in such a way* 
as to indicate that^they are thinking 
extroverts, whereas there are other 
questions which the majority of them 
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answer in such a way as to indicate 
that they are thinkirig introverts.- 
Specifically, L fount} that among the 
questions, which are supposed to* 
measure Slinking extroversion, 16 
are answered by the majority of these 
salesmen and sales managers in that 
way,* However, 12 of the questions, 
the majority^oi salesmen and sales 
managers answer in such a way as to 
indicate 5 thdl the^are thinking, Intro- 
vefls. 

Now, a ^st is of^use if it enables 
us to predict not only* the character- 
isfie that the individual has but 
.whether of not, in terms of the score 
on that characteristic, he will be 
effective jua a given situation. Obvi- 
ously, with the split of 16 and$12, 
any score which indicates that a man 
is a thinking introvert or a thinking 
extrovert would ; not predict the 
effectiveness of salesmen or, sales 
managers. * 
x I find a similar situation with .re- 
spect to the measure thai is called 
"Agreeablennss." There are LI ques- 
tions which the majority of salesmen 
answer*m s fcuch a way as to indicate 
that they are agreeable; but (here 
are 5 questions that the majority of 
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salesmen answer iri such a way as to 
indicate that they are not 'agreeable. 
In 'other words, while statistically 
these traits may be unitary traits, 
they .seem to nfe, in practical applica- 
tion, to represent statistical artifacts, 
which may be misleading to the in-, 
dividual who attempts to mak&a prac- 
tical applicatioiK^pf the tests and^re?! 
diet the kind of kehavjor which you 
would find in a ^given occupational 
situ^ion. 

Br, Cattelx: So far = as I under- 
stand tljat problemj it would nfean 
that the regraif^on equation that is 
the prediction of goodness of sales- 
manship is one combining several 
factors. I would not expect one uni- 
tary trait to predict performance at 
all well The point in my culminating 
paragraph when I spoke originally 
was that you a/e deliberately picking 
a number oW unrelated predictors 
which only when they are together 
can give you the maximum predic- 
tion. For the rest, that seems to me 
to deal with questions which Pro- 
fessor Guilford should answer as to 
the particular reliability of those 
particular items. 
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